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INTRODUCTION 


The Computer Sciences and Data Systems Technical Symposium was 
held to respond to the communications challenges posed by the rapidly 
advancing technical arena surrounding NASA personnel. This was the 
second meeting in what will be periodic gatherings. The intended 
purpose of these meetings is to bring NASA people together to present 
their progress, to air their thinking and, in general, to discuss the 
nature and results of their work within the agency on a wholly technical 
level. These meetings are not intended as a forum for program reviews, 
budget presentations or advocacy hearings. 

NASA personnel have long been recognized as prolific contributors 
to the journals of technical societies and organizations within the aero- 
space community. Symposiums such as this one, organized to improve 
the interchange of technical information and understanding within NASA, 
have resulted in valuable connections. These meetings will be continued. 
The Proceedings of the April 1985 Computer Sciences and Data Systems 
Technical Symposium are presented to provide a legacy for the latest 
gathering and a springboard to the next. 
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TOWARDS AN ASSESSMENT OF FAULT-TOLERANT 
DESIGN PRINCIPLES FOR SOFTWARE 
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FAULT-TOLERANT SOFTWARE 
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HARDWARE: N-Modular Redundancy Stand-By Sparing 

SOFTWARE: N-Version Programming Recovery Block 





FAULT-TOLERANT SYSTEMS BRANCH: SOFTWARE RESEARCH 
SUPPORTED BY THE COMPUTER SCIENCE PROGRAM 
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THE BASIS FOR FAULT-TOLERANT SOFTWARE 
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ASSESSING FAULT-TOLERANT SOFTWARE 
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GOAL OF CURRENT RESEARCH 
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-VERSION WITH MAJORITY VOTE 



1-8 


COINCIDENT ERRORS MODEL 
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A DISCRETE INTENSITY DISTRIBUTION 
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(e.g. on .001% of inputs, expect 10% of population to produce error) 


EFFECTS OF COINCIDENT ERRORS 
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SOFTWARE ERROR EXPERIMENT 



REPLICATE 1 REPLICATE K 
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PRELIMINARY RESULTS OF THE 
SOFTWARE REPETITIVE RUN EXPERIMENT 
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DISTRIBUTED COMPUTER TAXONOMY 
BASED ON 0/S STRUCTURE 


Dr. Edwin C. Foudriat 
NASA Langley Research Center 
Hampton, VA 23565 


Abstract 


The taxonomy considers the resource structure at the operating 
system level. It compares a communication based taxonomy with the new 
taxonomy to illustrate how the latter does a better job when related to 
the client's view of the distributed computer. The results illustrate 
the fundamental features and what Is required to construct fully distri- 
buted processing systems (network computer, "cooperative" autonomy, 
and decentralized computers). 

The talk then discusses the problem of network computers for space 
station noting that the evolution from computer network operating systems 
to network computer operating systems is not practical (almost infeasible). 
The research direction is then discussed with the NASA research into 
network computers being listed. 
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DISTRIBUTED COMPUTER TAXONOMY 
BASED ON 0/S STRUCTURE 


O COMPARE SIMILAR TAXONOMIES 
COMMUNICATIONS VS. 0/S 


O PROBLEM WITH NETWORK COMPUTER 0/S 
APPLICATION TO SPACE STATION 


O RESEARCH SUPPORTIVE NETWORK COMPUTER 0/S 


0/S OBJECTIVE: CREATE/CONTROL RESOURCES 

EFFICIENTLY SHARE RESOURCES AMONG SET OF 
USERS 
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d) MULTIPROCESSOR— ALGORITHM-DATA CONTROL PROCESSOR 
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NEW TAXONOMY FEATURES 


O BETTER REPRESENTATION OF CLIENT'S VIEW 


O DISTRIBUTED SYSTEM DISTINCTION 


COMPUTER NET. - LOCAL CONTROL EXCEPT COMM. 

COMM. RESOURCE VALUE-ADDED 


NETWORK COMP. - INTEGRATED LOCAL - NETWORK - 

DIST. CONTROL IN KERNEL 


O ADMIT. SEPARATE CLIENT BUILT RESOURCE 
OK, BUT LIMITED 

DIFFICULT SHARING - INTEGRATING IN 0/S 


O INDICATES CRITICAL RESEARCH FOR NETWORK 0/S 

BETTER HARDWARE - FIRMWARE - 0/S KERNEL 
DISTRIBUTED CONTROL SUPPORT 
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DISTILLING THE QUOTATIONS 



O CAREFUL 


OT BE A ROAD FROM COMP. NETWORK (LOS+NET.) 
TO NETWORK COMPUTER (LDOS) 


NO ROAD 


(NEW TAXONOMY) 


O NEW FEATURES NEED NEV 


O EMBEDDED O/S COMPLEX— SELECT WITH CARE - FOUNDATION OF 
SYSTEM 

O/S NASTY HABIT OF GETTING FIXED IN CONCRETE 


O COMPUTER NETWORK MODEL NOT APPROPRIATE FOR SPACE 
STATION 
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TAXONOMY - COMMUNICATIONS 
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SHARED MEM. GLOBAL CONTROL TRANS. RESOURCES CM* APOLLO 

TIGHTLY COUPLED MACHINE LEVEL DISTRIBUTED TASKING TANDEM, SYNAPSE, 

MESSAGES SEQUOIA, ETC. 

RELIABILITY FUTURE COMPUTERS 



TAXONOMY - 0/S CONTROL STRUCTURE 
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THE NETWORK COMPUTER PROBLEM - SPACE STATION 
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To envision the Space Station Computer System Network as a data management problem with the 
addition of some "standard" networking protocols is a serious error. To concern one's self with 
bandwidth, network protocol and transfer of uninterpreted data, etc. is naive, at best. Once this 
computer system is conceived as an extremely complex resource management and sharing problem, 
progress on its development will have begun. (Foudriat - LaRC - since 1981 ). 


OBJECT BASED 0/S 


OBJECT - ENCAPS'ULATION OF INFORMATION 

SPECIFIC MECHANISMS FOR USE (ACCESS, ETC.) 

SYNONYMS - PACKAGE (ADA), MODULE (MODULA - 2) 

GUARDIAN (CLU), OBJECT (PATH PASCAL) 


O 0/S PARADIGM OF 80s-90s - LIKE VMS-DOS (70s) 

UNIX FILE, C (80s) 

O OBJECT (NESTED) FOR EACH RESOURCE 
O FEASIBLE FOR EMBEDDED SYSTEMS (FOUDRIAT - 84-85) 
RESEARCH 

O STRUCTURE FOR DISTRIBUTED CONTROL 

O UNDERLYING COMPUTER SUPPORT 

(HARDWARE-FIRMWARE-O/S KERNEL-O/S LANGUAGE) 

O PERFORMANCE TRADES 

O DEBUG SUPPORT FOR DEVELOPMENT & TEST 
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NETWORK COMPUTER RESEARCH 
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MANY (AEROSPACE, IND, UN. GOVERN.) C.S. PROFESSIONALS (& LAITY) DO NOT UNDERSTAND 
THE SUBTLE NATURE OF THE DIST. 0/S PROBLEM. 



A MORKSTAIION ENV1KUNMEN1 
FUR SOFTWARE ENGINEERING 


N87- 29128 
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Presented at NASA Computer Science/ Data Systems Technical Symposium 

Leesburg, VA 
April lb, 198S 
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LANGLEY SOFTWARE ENGlhEEKlNG GROUP 
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D SOFTWARt ENGlNttklNti? 
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Parallel Architectures 
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Software layers make a "virtual machine" out of any parallel 
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New formal model of parallel computation 


N87- 2913 1 


HETEROGENEOUS DISTRIBUTED 
QUERY PROCESSING — 

THE DAVID SYSTEM 


Bart 7 E. Jacobs 
Senior Research Scientist 
Goddard Space Flight Center 
NASA 

Greenbelt, Maryland 20771 


ABSTRACT 

The objective of the Distributed Access View Integrated Database (DAVID) project 
is the development of an easy-to-use computer system with which NASA scientists, 
engineers and administrators can uniformly access distributed heterogeneous databases. 
Basically, DAVID will be a database management system that sits alongside already 
existing database and file management systems. Its function is to enable users to access 
the data in the other database and file systems without having to learn the different 
data manipulation languages. 

The scope of this talk will concentrate on the DAVID system and several related 
issues. First, we describe the problems caused by the diversity of database types and 
implementations. Second, we discuss two solutions to the problem — standardization 
and uniformization. Third, we consider the benefits of the recently developed uniform 
called "database logic." Fourth, we describe the DAVID system which uses database 
logic as its framework. Fifth, we outline the status of the development of the DAVID 
system. 


HETEROGENEOUS DISTRIBUTED 
QUERY PROCESSING — 

THE DAVID SYSTEM 


Barry E. Jacobs 
Senior Research Scientist 
Goddard Space Flight Center 
NASA 

Greenbeit, Maryland 20771 
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THE PROBLEM 


THERE ARE MANY WAYS FOR A SCIENTIST TO STORE DATA 
IN A DATABASE: 


file approach VMS, DOS, UNIX, ... 

relational approach Oracle, Ingres, dBase II, ... 

hierarchical approach IMS, RAMIS, ... 

network approach DEC— CODASYL, DMS/1100, ... 


THIS ABUNDANCE HAS RESULTED IN THE FOLLOWING; 

o A NASA SCIENTIST HAS TO LEARN MANY DIFFERENT ACCESS 
METHODS IN ORDER TO OBTAIN DATA. 

o THE DIVERSITY OF TYPES OF DATABASES RESULTS IN AN 
EXPLOSIVE REPETITION OF DATA AND DATABASES. 

o THE DATABASE PROFESSIONAL HAS TO LEARN MANY DIFFERENT 
TERMINOLOGIES IN ORDER TO READ THE LITERATURE. 
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OUTLINE OF TALK 


1. THE PROBLEM CAUSED BY THE DIVERSITY OF 
DATABASE TYPES. 

2. STANDARDIZATION VERSUS UNIFORMIZATION 

3. DATABASE LOGIC AS A UNIFORM 

4. THE DAVID SYSTEM 

5. DAVID SYSTEM DEVELOPMENT 


1-68 


STANDARDIZATION VS. UNIFORMIZATION 


STANDARDIZATION 

o IS AN *'A PRIORI" MEANS USED TO ESTABLISH COMMONALITY. 

o NEW DATABASES ARE SUBSEQUENTLY BUILT ACCORDING TO 
THESE "STANDARDS”. 

o CANNOT HELP IN THE CASE OF ALREADY EXISTING DATABASES 
NOT ADHEARING TO THE STANDARD. 

UNIFORMIZATION 

Q IS AN "A POSTERIORI” MEANS TO ESTABLISH COMMONALITY. 

o PERMITS DATABASE CONSTRUCTION WITHOUT CONSTRAINT ON 
THE USER. 

o CAN HELP IN THE CASE OF ALREADY EXISTING DATABASES. 
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THE RELATIONAL APPROACH 


DATABASES 


TAPEINFO 

NOTAPE 

TAPETYPE 

TITLEl 

TITLE 2 

TITLE 3 

1003 

SDT 

NIMBUS 6 . . . 

BY. . . 

DATA . . . 

1004 

3 DT 

NIMBUS 6 . . . 

BY... 



FILEINFO 

PB 



17400,0 



B 


17401 .0 

B 

1003 

17457.0 


1004 



1004 




RECINFO 

DATE 

TIME 

LON 

LAT 

ALT 


PB 

QUALITY 

ELECTR 

ILLUMIN 

CALIB 

SCAN 

790103 

124549 

158.57 

- 1.00 

1112.50 

153.63 

0 

0 

0 

0 

ON 

NIGHT 

NO 

OFF 

790105 

145629 

25.90 

-0.96 

1112.30 

153.97 

17459.0 

0 

ON 

NIGHT 

NO 

OFF 

790117 

110204 

2.75 

' 10.43 

1105.00 

34.11 

17457.0 

1 0 

ON 

NIGHT 

NO 

OFF 

790107 

10 53'*9 

4.82 

10.84 

1103.00 

35.59 

17401.0 

8 

OFF 

DAY 

YES 

ON 


QUERIES ON DATABASES 


select (t.tapetype, t.titlel, t.title2, t.titleS) as result 
from tapeinfo t, 
fileinfo f, 
recinfo r 

where t.notape = f.notape 
and f.pb = r.pb 
and r.zen = 153.63 
and r.calib = ’NO’ 
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I 
















ORIGINAL PAGE IS 
OF POOR QUALITY 


THE DATABASE LOGIC APPROACH 

DATABASES 


RTAPE 


NCTAPE 

TAPETYPE 


PLAYBACK 

RTITLE 

PB 

NOFILE 

CATALOG 

TITLE 

LON [ LAT I ALT 1 ZEN [tiMEI 
QUALITY|ELECTRjILLUMIN |CALIB| SCAN 

1010 

SDT 

e(PLAYBACK) il 

e(RTITLE) il 

81261.4 

4 

e( CATALOG) il 

NIMBUS6. . . 

-i 33 . 69 r- 55 . 62 Fli 23 . 70 l 98 . 7 i Io 12076 
1 ON |TWILIGHT| NO j OFF 

BY. . . 

n A m A 
un i. A • • • 

- 131 *. 25 I -56.'*7lll23.9oT97.82 I 012109 

1 1 ON 1 TWILIGHT 1 NO j OFF 

2010 

SDT 

P^PT.AYRArK-^ .? 1 

i 

6 (RTITLE ) : 2 

81261.0 

3 

e(CATALOG) i2 

NIMBUS7. . - 

155.04 i - 80 . 07 fli 26 . 80 l 66.65 I 021349 
0 ON |DAY 1 NO OFF 

BY. . . 

HAT A 



Uii 1 A • 0 • 


NOTAPE 

TITLEl 

TITLE2 

TITLE3 

1010 

NIMBUS6 , . . 

BY. . . 

DATA . . . 

2010 

NIMBUS7... 

BY. . . 

DATA . . . 


QUERIES ON DATABASES 


select (rpc.tapetype, f.titlel, f.title2, f.titleS) as result 
from rtape— playback— catalogue rpc, 
functions f 

where rpc.notape = f.notape 
and f.pb = r.pb 

and rpc.zencalib = ’153.63*||’NO* 
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DATABASE LOGIC AS A UNIFORM 


1. DATABASE LOGIC IS A THEORETICAL FOUNDATION FOR THE 
STUDY OF DATABASE ISSUES: 

First-Order logic is to the Relational Case 
as 

Database logic is to the Heterogeneous Case 

(Relational, Hierarchical and Network) 

2. DATABASE LOGIC HAS BEEN APPLIED TO A NUMBER OF 
FUNDAMENTAL DATABASE ISSUES: 

- external— to— conceptual mapping, 

— view update, 

- view integration, 

— database conversion, 

- automatic program conversion, and 

— external axiomatization. 


3. DATABASE LOGIC SERVES AS THE FOUNDATION FOR THE 
DEVELOPMENT OF A SYSTEM FOR ACCESSING HETEROGENEOUS 
DISTRIBUTED DATABASES. 

4. DATABASE LOGIC SERVES AS THE BASIS FOR BUILDING EXPERT 

SYSTEMS ON TOP OF ALREADY EXISTING DATABASES AND EXPERT 
SYSTEMS. 
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I I COMPLEX-TO-BASIC 
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THE DISTRIBUTED ACCESS 
VIEW INTEGRATED DATABASE 

(DAVID) 

SYSTEM 







DAVID DEVELOPMENT: 


MILESTONES 


MILESTONE A. (Summer 1985) 

Build a demonstration system using the following environment: 

VAX under VMS using an ORACLE DBMS 
SUN under UNIX using a DAVID network DBMS 
PC under DOS 2.0 using a dBASE II DBMS 
MACINTOSH under Mac OS 


MILESTONE B. (Summer 1987) 

Build a demonstration system using several of NASA’s real 
systems at: 

GSFC, ARC, GISS, JPL, NSTL 


1-74 


DAVID DEVELOPMENT: 


THE LOCAL DAVID. 


Ashok Agrawaia, University of Maryland 

Michael Anshel, City University of New York 

Joseph Aulino, USAF 

Kenneth Baum, USAF 

Jeanne Behnke, Johns Hopkins University 

Nancy Broderick, University of Maryland 

Isadora Brodsky, University of Puerto Rico 

Dehe Cao, Beijing Polytechnic University 

Upen S. Chakravarthy, University of Maryland 

Liang Fang, University of Maryland 

Adel Gharib, University of Maryland 

John Grant, Towson State University 

Kim Haynes, TRW Inc. 

Hsiao— Fang Hu, University of Maryland 
Kyu— Hyun Hwang, SAR Corp. 

Barry E. Jacobs, NASA 
Thomas E. Jacobs, University of Maryland 
Elizabeth Nichols, Digital Analysis Corporation 
Joseph Nichols, Digital Analysis Corporation 
Surrendra Ray, SAR Corp. 

Ira Sack, Stevens Institute of Technology 
Michael Shapiro, Beil Labs 
Due Tran, Digital Analysis Corporation 
Satish Trapathi, University of Maryland 
Cynthia A. Waiczak, NIH 

Jack Welch, The Catholic University of America 
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DAVID DEVELOPMENT: 
PROPOSED DAVID INTERFACES 


CENTER 

PROPOSED TESTBED 

UNIVERSITY 

ARC 

PLDS, LAS 

C.U.N.Y. 

GSFC 

PCDMS, PLDS, LAS 

U of Maryland 
Catholic University 

GISS 

ISCCP 

C.U.N.Y. 

JPL 

PODS, PLDS, PPDS, LAS 

U of Southern California 

NSTL 

PLDS, EOS 

Louisiana State University 

JSC 

TBD 

U of Houston 
Louisiana State University 

LeRC 

TBD 

U of Toledo 

MSFC 

TBD 

U of Alabama 

LaRC 

TBD 

Old Dominion University 
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SUMMARY 


1. THE PROBLEM CAUSED BY THE DIVERSITY OF 
DATABASE TYPES. 

2. STANDARDIZATION VERSUS UNIFORMIZATION 

3. DATABASE LOGIC AS A UNIFORM 

4. THE DAVID SYSTEM 

5. DAVID SYSTEM DEVELOPMENT 
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N87-29132 


INTELLIGENT DATA MANAGEMENT 


WILLIAM J. CAMPBELL 
SPACE DATA AND COMPUTING DIVISION 
DATA MANAGEMENT SYSTEM FACILITY 

nasa/gsfc 


Abstract 

Intelligent data management is the concept of interfacing a 

USER TO A database MANAGEMENT SYSTEM WITH A VALUE ADDED 
SERVICE THAT WILL ALLOW A FULL RANGE OF DATA MANAGEMENT 
OPERATIONS AT A HIGH LEVEL OF ABSTRACTION USING HUMAN WRITTEN 
LANGUAGE. THE DEVELOPMENT OF SUCH A SYSTEM WILL BE BASED ON 
EXPERT SYSTEMS AND RELATED ARTIFICIAL INTELLIGENCE TECHNOLO- 
GIES> AND WILL ALLOW THE CAPTURING OF PROCEDURAL AND RELA- 
TIONAL KNOWLEDGE ABOUT DATA MANAGEMENT OPERATIONS AND THE 
SUPPORT OF THE USER WITH SUCH KNOWLEDGE IN AN ON-LINE^ 
INTERACTIVE MANNER. SUCH A SYSTEM WILL HAVE THE FOLLOWING 
CAPABILITIES: 

• An UNDERSTANDING BETWEEN SCIENCE APPLICATIONS AND 
STORED DATA 

• The ability to construct a model of the users view of 

THE DATABASE^ BASED ON THE QUERY SYNTAX 

• The ability to transform English queries and commands 

INTO DATABASE INSTRUCTIONS AND PROCESSES 

• The use of heuristic knowledge to rapidly prune the 
DATA space in SEARCH PROCESSES 

• An on-line explanation system that will allow the user 

TO UNDERSTAND WHAT THE SYSTEM IS DOING AND WHY IT IS 
DOING IT 

Such a system will be goal oriented rather than procedure 

ORIENTED SUPPORTING VARYING LEVELS OF ABSTRACTION OF THE DATA 
OF INTEREST TO THE USER. 
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THE INFORMATION EXPLOSION 
PROBLEH/SOLUTION 
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THE APPLICATION OF ARTIFICIAL INTELLIGENCE (AI) TO 
EARTH SCIENCE INFORMATION MANAGEMENT OFFERS THE ONLY 
REAL POSSIBILITY OF REVERSING THIS TREND 
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HOW INTELLIGENT DATA MANAGEMENT CAN SUPPORT EARTH SCIENCE 
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THE CAPTURING OF HUMAN KNOWLEDGE INTO SYSTEMS THAT 
CAN BE USED BY NON-EXPERTS 
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WOULD USE HEURISTIC SEARCH PROCESSES THAT LEAD TO SHORTCUTS 
BT EARLY PRUNING OF LARGE PORTIONS OF UNWANTED DATA SPACE 


INTELLIGENT DATA MANAGEMENT 
"AfiSTRAGTION PYRAMID'* 
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image FEATURE DETECTION 

FEATURE AND EXTRACTION 


o 


00 





z 




LU 

o 

Z 00 



o z 

•— i 

z z 



z < 

i— 

<C H- 1 



LU O 

o 

z 



•—1 

< 

o z 



o z 


H- Z 



oo o 

LU LU 

cy 



1— ^ 

H— O 

Q 



z z 

< z 

UJ LU 


LU 

h- 3 

♦— 1 

h- 00 


o 

Qc: 

(Z z 

— • < 


< 

<C LO 

Q. LU 

Z CO 


ZD 

LU z 

O }— 

< 


o 

< 

Z 1— 

— J H— 


z 

CD Qi 

z z 

< 


< 

Z CD 

z 

LU Q 


—I 

1-4 o 

< z 

Z 



or 

o 

<c • 


"Zl 

01 Q- 

LU 

CD 


< 

o 

Z 

OO • 

LlJ 

21 

o- q: 

h- X 

Z LU 

O 

z> 

Q. LU 

LU 

O' — 

c 

z: 

^ f— 

Z h- 

1— • 

ZD 


oo z 

z 

1— >- 

o 

Q 

a. 

O LU 

< z 

z 

UJ 

QC Z 

Z Z 

o <: 

< 

h- 

o o 

Z 1— 


—I 

< 

LU O 

LU 

-J o 


s: 


Z Z 

z ►-* 

— 1 

o 

CD LU 

1— 1 

CU h— 

< 

1— 

z o 

Q 

< o 

q: 

Z3 


Z Q 

»— » 

ID 

< 

oo 

<C UJ 

Z CD 

h- 


00 z 

z 

CD 

< 

oo 

LU LU 

LU •— ( 

< Q 


z 

O Z 

CD < 

o z 


< 

o a. 

< 1— 

o »— 


LlI 

O 

z z 

Z1 


21 

Q 1 

CD O 

z 



LU 

z o 

Z ►-I 


LU 

LU D> 

< 

z 


CD 

CD LU 

-U z 

z 


< 

< Q 

o 

< < 


ZD CD 

Z 

z • 

z 


CD Z 

O LU 

< h- 

z z 


Z •— * 

z z 

z < 

z 


< Q 

< h- 

z z 

< — • 


_U Z 

-J 

z z 

z z 


< 

00 

o 

cx 


-J h- 

^ LU 

LU Z 

h- Z 


< OO 

< > 

fvl Z 

z z 


cc cc. 

CC -J 

>- • 

z 


13 LU 

z o 

-U 

00 h- 


h- Q 

1— > 

C z 

Z cC 


< Z 

< z 

z z 

z z 


2: ZD 


C h- 

Z f— 


o 

o 


o 


1-86 


THE RELATIONAL APPROACH 


DATABASES 


TAfEINFO 

NOTAPE 

TAPETYPE 

TITLEl 

TITLE 2 

TITLE 3 

1003 

SDT 


BY... 

DATA... 

1004 

SDT 

NIMBUS 6 . .. 

BY... 

DATA... 


FILEINFO 

PB 

FILE 

NOTAPE 

17400.0 

2 

1003 

17401.0 

3 

1003 

17457.0 

2 

1004 

17459.0 

3 

1004 


RECINFO 

DATE 

TIME 

LON 

LAT 



PB 





SCAN 

790103 

124549 

158.57 

- 1.00 



17400.0 

0 

ON 

NIGHT 

NO 

OFF 

790105 

145629 

25.90 

-0.96 



17459.0 

0 

ON 

NIGHT 

NO 

OFF 

790117 

110204 

2.75 

10.43 

1105.00 

34.11 

17457.0 

0 

ON 

NIGHT 

NO 

OFF 



4.82 

10.84 




8 

OFF 

DAY 

YES 

ON 


QUERIES ON DATABASES 


select (t.tapetype, t.titlel, t.title2, t.titleS) as result 
from tapeinfo t, 
fileinfo f, 
recinfo r 

where t.notape = f.notape 
and f.pb = r.pb 
and r.zen s 153.63 
and r.calib s ’NO’ 
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DATA MANAGEMENT CONTKOLLER 
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FIGURE 4. QUADTREE STRUCTURE (FROM HUNTER AND STEIGLITZ, 1979) 
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SELECT DATA SETS FROM LANDSAT CREATED FOR USER 

FROM THE TM SENSOR. IN BAND 2.3.4 
FOR QUARTERS 1, 2, 3. 4 FOR YEARS 
1983 , 84 , 85 FOR LAND AREA LAT/LONG 


IF QUERY SUPPORTS SOIL EROSION ANALYSIS THEN THE TYPE OF SENSOR 
THAT SHOULD BE USED IS INFRARED IMAGING 
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INTELLIGENT DATA MANAGEMENT CONCEPT 
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Software Management Environment 


Frank McGarry - Goddard Space Flight Center 


There exists an overall RTOP effort, supported by Code R, which is 
attempting to define, assess and integrate software measures and tools 
into an environment that will aid the management process for software 
development. During this briefing, examples of three specific areas of 
work are discussed. These areas are: 


1. Research into the development of Software Design measures 

2. Research into the development of Software Specification measures 

3. Attempts at integrating identified measures and models into a 
'Dynamic Management Information Tool ' (DYNAMITE) 


A. Design Measures 


By closely studying and monitoring numerous software development projects 
at Goddard, several promising approaches to assessing design charac- 
teristics have been developed. One is a mechanism by which the classical 
measures of 'strength' and 'coupling' are extracted at design time and 
are used to predict reliability and overall quality of the software 
product. Early indications imply a high correlation with overall 
reliability and productivity of the end product. 


A second design measure being investigated is one that tracks the 
evolution of the general architecture of a software system during the 
design process. Early results imply that projects with apparent 
disparity between the evolution of 'data structure' and 'control 
structure' will be more likely to have reliability problems later. 

B. Specifications Measures 


Attempts were carried out at developing measures by which software 
specifications could be used to predict complexity, reliability and 
other characteristics of the software product. One approach was 
utilized where objective measures (or counts) of such items as number 
of external file requirements, size of specifications, number of 
processes, etc. resulted in a dead end; no reliable measures were 
identified. 


A second approach, called the Composite Specification Model (CSM), was 
applied to an ongoing project at Goddard and the early indicators show 
promise for this approach as a means for truly analyzing software 
complexity during the requirements phase. 

C. Dynamic Management Information Tool (DYNAMITE) 

A software tool has been designed which attempts to support the user in 
assessing software quality as well as predicting future events such as 
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schedules and cost. The tool has at its disposal a set of historical 
data on completed projects, a set of measures and models developed by 
this research effort, as well as an 'expert system' which contains a 
set of software development 'rules', also developed by this and other 
research projects. 

This tool exists in the prototype stage and currently contains about 100 
rules. It utilizes the KMS inference engine and currently has the 
capability of performing some very basic predictions and assessments of 
active projects where some very basic development information is made 
known to it. 
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SOFTWARE MANAGEMENT ENVIRONMENT FOR NASA 
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SOFTWARE MANAGEMENT ENVIRONMENT 

AREAS OF CONSIDERATION 
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SOFTWARE ENGINEERING LABORATORY 

DATA STUDIED 
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OVERALL EXPERIENCE 

MANAGERS 10.0 14.0 

TECHNICAL STAFF 8.5 11.0 

SAMPLE: 22 SYSTEMS USING A VARIETY OF TECHNOLOGIES 



STRENGTH AS A DESIGN MEASURE 
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Error. LE. 2/ 1000 L.O.C 


DESIGN IS A PARTITIONING OF STRUCTURE 
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Developing 'Specification' Measures 
OUR APPROACH 
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FIVE FLIGHT DYNAMICS SOFTWARE PROJECTS 
NEW SOURCE LINES VS. PAGES OF REQUIREMENTS 
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PAGES IN REQUIREMENTS DOCUMENT 


OUR REVISED APPROACH 
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RESULTING MEASURES 



lU 

cc 


< UJ 



O < 


2 

O 

<E 

cc 


< 

^ i 

t < 

2 2 

O > 

O Q 


i 

I 

oc 

o 

< 

4 


1-106 


EXAMPLE OF FUNCTIONAL VIEW 
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EMPTY S/C COG 
TANK POSITION 


EXAMPLE OF CONTEXTUAL VIEW 
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FUEL FLOW RATE 











EXAMPLE OF DYNAMIC VIEW 
(STATES AND TRANSITIONS) 
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714-AON-IWil 


STEP 2: DEFINE MEASURES BASED 
ON THE COMPOSITE SPECIFICATION 
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714-AQR*<tfl 



1-111 


714-AQR-(8te) 


STEP 4 EXTRACT THE MEASURES 
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• ATTRIBUTES 

• VALUE SETS 
DYNAMIC VIEW 

• STATES 

• TRANSITIONS 
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NEED TO MEASURE MORE PROJECTS 


CONCLUSIONS 
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DYNAm ic Management information lool 

The Idea 
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SOFTWARE MANAGEMENT ENVIRONMENT 

DYNAMIC MANAGEMENT INFORMATION TOOL (DYNAl 
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anned work 



DYNAMITE EXPERT SYSTEM 


<v 

CT> 

~o 

03 

o 

c 



C <1^ 

2 S 
5 

e a; 
o) -3 
10 ^ 

QJ ^ 
L_ 

Q- I 


to 


O 

O 


“O 

cz 

^ -2 
uj 


o> 

> 


W- 

o 


1-117 


KMS - Knowledge approximate'/ tOO rules 

Management System - Frame based 

- Hypothesize ond Test 




RULE 1: If computer run per line of source code is above normal 
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DYNAMITE SCENARIO UTILIZING EXPERT SYSTEM 
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MASSIVELY PARALLEL PROCESSOR 


'I 


The Massively Parallel Processor (MPP) was delivered to NASA Goddard 
in May 1983, by Goodyear Aerospace Corporation following four years of 
development. MPP is the product of a research and technology program 
designed to evaluate the application of a computer architecture 
containing thousands of processing elements (PE's), all operating 
concurrently, to the computational requirements of the sensors of the 
next decade. 

Major applications of the MPP are in the area of image processing 
(where operands are often small integers) from very high spatial 
resolution passive image sensors, signal processing of RADAR data, and 
numerical modeling simulations of climate. 

At the heart of the MPP is a custom integrated circuit chip containing 
8 PE's. 2112 of these chips have been combined with commercial memory 
and control chips to pack into 18 square feet of floor space the 
capability to perform 400 million floating point operations per second 
and 6 billion fixed point operations per second. The system can be 
programmed in assembly language or a high level language. Parallel 
Pascal, which is an extension of standard Pascal. Research is 
underway to develop techniques and programming tools to better expose 
the power of the massive parallelism. 

Because the MPP is a one-of-a-kind system and is not a commercial 
product supported by the field engineering wing of the manufacturer's 
organization, NASA has assumed responsibility for providing all spare 
printed circuit boards, spare component parts, diagnostic software, 
and an on-site maintenance engineer. Spares exist for only 11% of the 
printed circuit board assemblies so hardware failures must often be 
traced to the failed component while users wait. This situation has 
proved workable, though ocassionally tenuous when several failures 
occur close together in time. 

The MPP is being developed as a national resource around which will 
grow a diverse community of science and applications users requiring 
its unique parallel processing capabilities. Their work will help 
determine the practical computational limits of the MPP's parallel 
architecture. A Space Science and Applications Notice (AN) titled 
"Computational Investigations Utilizing the Massively Parallel 
Processor" v/as issued in December 1984. It announced an ongoing 
opportunity to carry out computational investigations exploiting the 
unique characteristics of the MPP. Despite the fact that no funding 
was offered, forty proposals were received. Their topics were spread 
almost evenly across the categories of signal and image processing, 
earth sciences, physics, and computer science. Those investigators 
whose proposals are accepted will form the first MPP working group. 
Their experiences and recommendations will play a large factor in 
motivating future enhancements to the current system and in justifying 
future NASA efforts in parallel processor development. 
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OVERV lEW 
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GOODYEAR AEROSPACE CORPORATION DEVELOPED THE MPP SYSTEM 
UNDER CONTRACT. 


Hybrid LAN/OCCnet 
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Access to Supercomputers 
via Hybrid L4H 
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MAPPING TO HARDWARE ' (ACTIVE AREA OF RESEARCH) 


PARALLEL PASCAL (An EXTENSION OF STANDARD PASCAL) 
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MPP HARDWARE RELIABILITY SINCE NOVEMBER 15, 1984 
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THE GODDARD INVENTORY OF A CRITICAL COMMERCIAL CHIP WHICH FAILED OFTEN 
HAD NOT BEEN MANUFACTURED IN FOUR YEARS, AND WAS UNPURCHASABLE , 

WENT TO ZERO. COMPATIBLE 'REJECT* CHIPS WERE EVENTUALLY LOCATED 
AND THE PROBLEM WAS RELIEVED. 


MPP APPLICATIONS - TODAY 
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COMPUTATIONAL ENGINE RESEARCH 6SFC/630 ADV DEBUG 


MPP APPLICATIONS - TODAY (CONTINUED) 
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HILLSLOPE HYDROLOGICAL MODEL GSFC/620 DESIGN 
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MPP GOAL 
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BASIC PHYSICAL, MATHEMATICAL, & COMPUTER 
SCIENCES RESEARCH 
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GENERAL SCIENTIFIC USE 
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Satellite Data for Precision Orbit Determination Madrid 

JPL 
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Numerical Calculations of Charged Particle Transport earl 


COMPUTER SCIENCE 
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TRW 

Generate Topographic Maps From Spacecraft Imagery strong 

GSF c/636 

Animated Models of Space & Earth Sciences Data treinish 

gsfc/634 
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Superconq>uting on Massively Parallel Bit-Serial Architectures 


Consider the idea that supercomputing is a synergy of generic 
algorithms, languages and architectures and that real breakthroughs in 
parallel computing will be achieved by considering all three together in a 
simulated software environment. Engineering tradeoffs could be made between 
performance, machine transparency, standardization and program portability 
before any new machines are actually built. Standardized languages could be 
developed for generic subclasses of parallel machines; languages that really 
give high peforraance and encourage free parallel expression and "thinking in 
parallel ". 

My own research on the Goodyear MPP (Massively Parallel Processor) , 
suggests that high-level parallel languages are practical and can be 
designed with powerful new semantics that allow algorithms to be efficiently 
mapped to the real machines. For the MPP these semantics include parallel/ 
associative array selection for both dense and sparse matrices, variable 
precision arithmetic to trade accuracy for speed, micro-pipelined "train" 
broadcast, and conditional branching at the PE control unit level. 

The preliminary design of a FORTRAN-like parallel language for the MPP 
has been completed and is being used to write programs to perform sparse 
matrix array selection, rain/max search, matrix multiplication, Gaussian 
elimination on single bit arrays and other generic algorithms. The MPP 
timing estimate for Gaussian elimination of a 4K by 4K single bit matrix is 
under one second — the equivalent of approximately 64 billion scalar 
operations. Parallel Gauss-Jordan matrix inversion is also being investi- 
gated. The estimated time to invert a 128 X 128, 32 bit real matrix using 
full pivoting on the MPP is 50 msec. This is roughly equivalent to a 100 
MFLOP scalar rate. 

The MPP is a SIMD machine of 16384 single bit processors arranged in a 
128 X 128 array. Individual PE's are Interconnected with their four nearest 
neighbors. Each PE can address 1024 bits of its own local memory. A 32 bit 
shift register in each PE allows for micro-pipelining of long words and 
faster partial sum accumulation for multiplication. The machine can execute 
160 billion micro-instructions per second which translates to 800 GOPS for 
some instructions. Operations include single bit logical, shift, and add as 
well as column I/O and one or two dimensional routing in a spiral, 
cycllnder, or torus. All operations can be directly or indirectly masked. 
The logical "or" of one bit per PE (SUMOR) can be used to pass array 
information back to the PE control unit for broadcast to other PE's, scalar 
I/O or conditional branching. If a second MPP were ever built, it might 
look considerably different than the current MPP. For example, it would 
certainly have greater memory depth — at least 64K bits per PE. It might 
also have a reconf Igurable bit/byte serial ALU, staged PE's for table lookup 
arithmetic, and pipelined SUMOR logic. 


Ken lobst 
4/15/85 
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SUPERC0MPUTIN6 ON MASSIVELY PARALLEL 
BIT-SERIAL ARCHITECTURES 


• SUPERCOMPUTING DOMAIN 

• NEW DIMENSIONS IN PARALLEL COMPUTING 

• SOME GENERIC ALGORITHMS 

• THE GOODYEAR MPP 

• SOME MPP SPECIFIC ALGORITHMS CODED IN A FORTRAN-LIKE 
BIT-SERIAL PROGRAMMING LANGUAGE 

• WHAT MIGHT A SECOND GENERATION MPP LOOK LIKE? 


SUPERC0MPUTIN6 DOMAIN 


PARAlia 

PROGRAMS 



SIMULATED SOFTWARE ENVIRONMENT 


1-147 



COfJTI^OL 

SIfiMftLS 
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MILLIONS OF OPERATIONS PER SECOND 


2603 


mpp PERFORMANCE WITH INTEGER OPERANDS 
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DIVISION BY example 


FROM THE BINOMIAL THEOREM, 


\±?c 


1 qp X 


3 

X +■ 


Cx-"< 1) 


BY A CHANGE OF VARIABLE THEN 









NOW LET j=:2^ AND DIVISION BY Z^i:) 
REDUCES TO A SHORT SEQUENCE OF BINARY 
SHIFTS AND ADDS (AND/OR SUBTRACTS), 


^ JfL- -y' -v- _ 

2^±. I ■*" 

FOR EXAMPLE, LET V = 237658 AND N = 10 
THEN 


V" 



AFTER 3 


Z3~7CS’S- 
) OZf 


Z3Z. ^1-5” 


SHIFTS AND 2 ADDS 
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THE GOODYEAR MPP 


I SIMD MACHINE OF 1638^1 SINGLE BIT PROCESSORS ARRANGED IN A 
128 X 128 ARRAY 

• NEAREST NEIGHBOR INTERCONNECTIVITY 

I 1024 BITS OF MEMORY PER PE 

I 32 BIT SHIFT REGISTER ALLOWS FOR MICRO-PIPELINING AND 
FASTER MULTIPLICATION 

I EXECUTION SPEED OF 160 BILLION MICRO-INSTRUCTIONS PER SECOND 
WHICH TRANSLATES TO 800 GOPS FOR SOME INSTRUCTIONS 

• OPERATIONS INCLUDE SINGLE BIT LOGICAL. SHIFT. AND ADD AS 
WELL AS COLUMN I/O AND ONE OR TWO DIMENSIONAL ROUTING IN 
A SPIRAL. CYLINDER. OR TORUS 

• ALL OPERATIONS CAN BE DIRECTLY OR INDIRECTLY MASKED 

• THE LOGICAL "OR" OF ONE BIT PER PE (SUMOR) CAN BE USED TO 
PASS ARRAY INFORMATION BACK TO THE PE CONTROL UNIT FOR 
BROADCAST. SCALAR I/O. OR CONDITIONAL BRANCHING 
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ONE OF 16384 MPP PROCESSING ELEMENTS (PE'S) 
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FROM WEST ^ 5 TO EAST RAMBOM-ACCESS ./jpORESS 

PE HCMORY 







PARALLEL/ASSOCIATIVE ARRAY SELECTION 


I PARALLEL 



S»SUM0R(A[64.256]) 
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MAXIMUM OF 32 BIT INTEGER ARRAY 
(OF UNIQUE VALUES) 


BIT MAXI 1 

INTEGER A[128.1281(0:32) 

MAX=1 

DO 1 I=L32 

IF (SUMORCAIMAXKI))) MAX=A[MAX]( I) 
1 CONTINUE 


; Declare MAX as bit mask 
OVER ALL PE's 

; Declare A as a 128 X 128 
UNSIGNED integer ARRAY 
; Initialize MAX to 1 over 
ALL PE's 

) Scan bits in A from most 

TO LEAST SIGNIFICANT BITS 

; Replace MAX with a new 

SUBSET OF MAXIMUM VALUES 
FOR EACH NON ZERO BIT 
PLANE OF A 


MAXIMUM OF 32 BIT INTEGER ARRAY 
(GENERAL CASE) 


BIT MAXI ] JI ](i<6).INDEXI ](14) 

INTEGER AI128U28](0:32) 

COMMON /INIT/ INDEX ; Same algorithm as before 

EXCEPT A ARRAY IS FIRST 
CONCATENATED WITH THE 
PE ADDRESS FIELD TO INSURE 
UNIQUENESS OF RESULT 

MAX=1 


T=A.C0N. INDEX 
DO 1 I=L46 

IF (SUMOR(TIMAXKI))) MAX=TIMAX](I) 
1 CONTINUE 
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MATRIX MULTIPLICATION EXAMPLE 



CP 


Ov 

X 

M 

00 




REAL A[ 8, 16,128 1(8; 32), 6(8,16,128) (8: 32) 
6(8,16,1281 (8:32),T[8,16, 1281 (8:32) 

READ A(, ,11,6(1,, I 
T"A( ,,1**»)*6(1,..,,1 
C=T(,t,l 
PRINT C(,l,l 


COLUMN BROADCAST EXAMPLE 



REAL A[128. 1281(8:32) 
A=A(.J...l 


OR 


REAL A(128. 1281(8:32) 
BIT M[ 1 
M=[128.128; J1 
A=A[.N0T.MH,128-^1 
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COLUMN BROADCAST EXAMPLE 


PROBLEM: 

SOLUTION 

SOLUTION 


TO BROADCAST A COLUMN OF FLOATING POINT NUMBERS 
ACROSS THE MPP ARRAY 

#1: WITH PE'S INTERCONNECTED IN AN E/W CYLINDER; 

LOAD. SHIFT AND STORE THE 32 BIT VALUES 
ACROSS THE ARRAY. THIS TAKES APPROXIMATELY 
3 X 32 X 128 = 12288 CYCLES. 

#2: WITH PE'S INTERCONNECTED IN AN E/W CYLINDER; 

"TRAIN" BROADCAST THE 32 BIT VALUES ACROSS 
THE ARRAY. THIS CAN BE VIEWED AS A MICRO - 
PIPELINING OPERATION AND TAKES ONLY 207 CYCLES. 

THE ALGORITHM IS AS FOLLOWS; 

I GET "TRAIN" OF 1 STOP BIT + 32 BIT VALUES 
OUT ONTO THE E/W PE CHANNEL ( - 33 CYCLES) 

• CIRCULATE "TRAIN" ONCE AROUND ( * 128 CYCLES). i 
DURING THIS PROCESS INDIVIDUAL PE'S WILL 
STORE THE "TRAIN" IN THEIR SHIFT REGISTERS. 
SHIFTING STOPS WHEN THE STOP BIT ENTERS THE 
CONDITIONAL MASK REGISTER OF EACH PE. 

I STORE ALL SHIFT REGISTERS ( « 32 CYCLES). I 
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ELIHINATIOH EXAMPLE 











GAUSSIAN ELIMINATION EXAMPLE 


BIT A[W00.4](1000).M[i|000.4].USED(^«)00) 

INTEGER PIVOT(i|000.0:14)Jl(0:2)J2(0:12)J(0:14) 
EQUIVALENCE (J1J(1)).(J2J(3)) 


READ A 

DO 1 I=l™ 

USED(I)=0 

1 CONTINUE 

DO 7 I=L4000 
DO 2 J2=U000 

IF (SUMOR(A(U(J2))) GO TO 3 

2 CONTINUE 
GO TO 8 

3 CONTINUE 

DO 4 Jl=l,4 

IF (SUM0R(A[IJ11(J2))) GO TO 5 

4 CONTINUE 

5 CONTINUE 
PIVOT(I)=J 
USED(J)=1 

M=A[ ](J2).AND..NOT.[4000,4jIJl] 


DO 6 J2=U000 

A[ ](J2)=A[ l(J2).XOR.MUl...l 


6 CONTINUE 

7 CONTINUE 

8 CONTINUE 


j Read in array 
1 Initialize history matrix 


j Search for a 1 in row I 
IN STEPS OF 4 COLUMNS 

; Row OF ALL O's - EXIT 

; Find WHICH column of 4 


j Save history information 
i Save pivot column in new 

MATRIX M^ ZEROING THE PIVOT 
ROW VALUE 

J Eliminate 4 columns at a time 

BY BROADCASTING THE PIVOT 
COLUMN ACROSS THE M ARRAY 
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GAUSS-JOROAN NATRIX INVERSION 


WITH FULL PIVOTING 
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PARALLEL DATA STRUCTURES 


REAL ARRAYS 

U - C A : I ] AUGMENTED MATRIX 

V - [ : ] WORKING ARRAY 

W - i : ] WORKING ARRAY 

BIT MASKS 

X - [ I ; 0 ] PIVOTED ROW/COLUHNS 

Y = [ T : T ] PIVOT ROW 

WHERE I IS THE IDENTITY MATRIX 
T IS THE UNITY MATRIX 
0 IS THE ZERO MATRIX 
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OTHER DATA STRUCTURES 


SCALARS 


DET - 1 


PIVOT 
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PARALLEL APPROACH TO MATRIX IHVERSIOM 


REPEAT FOLLOWING STEPS N TIMES 

• FIND NEXT PIVOT 

• UPDATE DETERMINATE (OPTIONAL) 

• ZERO PIVOT ROW AND COLUMN IN X 

• ZERO PIVOT ROW IN Y 

• NORMALIZE PIVOT ROW IN U 

• BROADCAST PIVOT ROW N TIMES INTO V 

• BROADCAST PIVOT COLUMN 2N TIMES INTO W 
I PERFORM PARALLEL ROW OPERATIONS FOR A 

SINGLE PIVOT 

• RESET PIVOT ROW IN Y 


THEN REORDER ROWS IN U TO FORM 
U - C I : a'^ J 
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PARALLEL MATRIX INVERSION ALGORITHM 


FOR I - 1 TO N 

PIVOT - MAX|u| PER X 
DET - DET • PIVOT 



0 

0 

PIVOT 



iW ] 


U - U - V * W PER Y 




1 


END I 

FOR J - 1 TO N 
FOR I - 1 TO N 

IF UCI,J] » 1 THEN VCJ,*] - UCL*] 
END I 
END J 
U - V 
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MPP II; 

WHAT MIGHT IT LOOK LIKE? 


• MUCH GREATER MEMORY DEPTH: AT LEAST 6AK BITS 
PER PE. WITH AT LEAST ONE LEVEL OF INDIRECT 
ADDRESSING. 

I RECONFIGURABLE BIT/NIBBLE/BYTE SERIAL ALU 

• STAGED PE'S FOR TABLE LOOKUP ARITHMETIC. 

HOW MANY TABLES? WHAT SIZE? RAM OR ROM? 

• PIPELINED SUMOR LOGIC 
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PROTOTYPE FAULT ISOLATION EXPERT SYSTEM 


N87- 29136 
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PROTOTYPE FAULT ISOLATION EXPERT SYSTEM FOR SPACECRAFT CONTROL W. TRUSZKOWSKI 
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This activity has provided insight into the use of expert system technology in the spacecraft ground 
command/control environment. This prototype system will now be used to demonstrate and evaluate the 
use of expert systems in a control center environment. The propulsion system simulation and display 
approach should allow control center operators to experiment with and understand the operation of expert 
systems and gain confidence in their operational use. 




ISEE Hydrazine Propulsion System 
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fuel pressure sensors, fuel line and 
catalyst bed sensors [on/off], fuel line 
and catalyst bed temperature sensors) 
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USER SPECIFIES TYPE AND LOCATION OF FAULT 
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MODEL IS MODIFIED AND TELEMETRY NORMALIZES 


KNOWLEDGE BASE ARCHITECTURE 
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(LISP procedure to print explanation) 
(place data/ result in working memory)))) 
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Extended Abstract 




In September 1984 RIACS conducted a two-week study of the proposed 
MIT static data flow machine for applications of interest to NASA Ames and 
DARPA. ISiASA and RIACS scientists formed seven one- or two-person teams 
to study data flow concepts, the static data flow machine architecture, and the 
\ AL language. Each team mapped its application onto the machine and coded 
it in VAL. 

The application areas were computational fluid dynamics, computational 
chemistry, galactic simulation, linear systems, queueing network models, and 
artificial intelligence. The considerations for mapping these applications onto 
the machine were primarily architectural: the number of individual processing 
elements (PE), the size of the instruction memory in each PE, the speed of the 
PEs. the instruction issue rate, the size of the routing network among the PEs. 
and the size and speed of the array memory. The goal in mapping was to max- 
imize the number of busy PEs and to minimize the traffic on the routing net- 
work. The target machine contained 256 PEs and was capable of an aggregate 
rate of 1.28 GFLOPS. 

The principal findings of the study were: 

1. Five of the seven applications used the full power of the target machine — 
they sustained rates of 1.28 GFLOPS. The galactic simulation and mul- 
tigrid fluid flow teams found that a significantly smaller version of the 
machine (16 PEs) w’ould suffice. 

2. A number of machine design parameters including PE function unit 
numbers, array memory size and bandwidth, and routing network capability 
were found to be crucial for optimal machine performance. Thus, studies of 
this type can provide valuable feedback to machine architects. 

3. The study participants readily acquired VAL programming skills. A very 
high level programming environment is essential to make the data flow 
machine usable by most programming scientists, however, because of the 
complexity of the machine architecture. For example, tools to aid debug- 
ging and mapping ^’AL programs onto the architecture are required. 

4. We learned that application-based performance evaluation is a sound 
method of evaluating new computer architectures, even those that are not 
fully specified. During the course of the study we developed models for 
using computers to solve numerical problems and for evaluating new archi- 
tectures. We feel these models form a fundamental basis for future evalua- 
tion studies. 
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RIACS 


Institute of the Universities Space Research 
Association (USRA) 

• Began operation June 1983 

Purpose 

• Strengthen CS at Ames Research Center 

• Strengthen ties to University and Industry 


Technical Program 

• Independent research (core) 

• Joint projects (tasks) 


Central Theme — 

Integration of concurrent processing and 
artificial intelligence into every aspect of 
scientific investigation 
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study of MIT Static Data 
Flow Machine and VAL 
Language 

• Jointly funded by NASA and DARPA 

• Focussed on algorithms for several 
applications 


Goals 

• Gain experience with VAL, pipe-structured 
programming, machine architecture 

• Estimate machine performance 

• Evaluate system usability 

• Assess study value and methodology 
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Motivation 

• Progress in concurrent processing research 
limited by lock of understanding of 
interactions between 

— computational models 

— system architecture 

— classes of algorithms 

• Goal is usable systems 

• Model of computation can be an experiment 
focus 
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Nature of Study 

• Six application areas studied 

Computational fluid dynamics 
Computational chemistry 
Galactic simulation 
Linear systems 
Natural language processing 
Queueing network models 

• Eleven team members — expert in discipline, 
novice to data flow 

• Two weeks release time from normal duties 

• Study held away from daily distractions 

• Familiar computer environment ported to 

facility for each participant; no time 
spent learning new system 
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start Here if 
new Model of 
Computation 


Start Here if 
same Model of 
Computation 


Problem 

Statement 

prose 


Mathematical 

Model 

mathematics 


Abstract 

Algorithm 

discrete math. 


High-level 

Program 

VAL 


Machine 

Program 

mach. lang. 


Work done 
within 
discipline 

Discretization, 
approximation, 
partitioning, 
divide and 
conquer 

Mapping 
to specific 
'architecture 


Compilation 

and 

optimization 


Steps in Problem Solving 
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static Data Flow Model of 
Computation 

• Program is a directed graph 

— graph nodes represent instructions 

— operands travel on edges 

• Instruction enabled by presence of operands 
and permission to send result 

Example: 


X = 3*(A+B) 




RN — Routing Network. 

PE — Processing Elements. 
IS — Instruction Store. 

AM - Array Memory. 

I/O - Input/Output. 


Static Data Flow Machine Architecture 
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VAL — Value— Oriented 
Algorithmic Language 

• Functional 

• Single assignment 

• Side— effect free 

• Modular - external and internal functions 

• Data treated as values not objects 


A, B, C := 

forall J in [1,N] 

X: real := square-root (real(J)); 
construct J, X, X/2 
endall 



Computational Fluid 
Dynamics 

CSM 



structure of CSCM Data Flow Program 


• 3-D with 10,000 grid points per 4— PE 
"cluster" to achieve peak speed 

• PE instruction store probably too small 

• Recomputation done to save memory 
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Computational Fluid 
Dynamics 

Euler Method 

• Method routinely used by industry 

• Describes inviscid, compressible fluid flow 


Findings 

• Handle boundary conditions better than 
vector processors 

• Limited parallelism; machine with 16 PEs may 
be good choice 

• Tiny scalar speed of single PE may be 
problem 
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Computational Chemistry 

• Calculate material properties from 
fundamental physics 

• Complements and supplements experiment 

• Problem sizes often 

— 40,000x40,000 random sparse arrays 

— 400 billion floating point operations 

— 64 Mword files 

• Currently studying Kapton to understand 
degradation experienced on Shuttle missions 
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Findings 


• Algorithms adaptable 

- Diatomic Integral Code (DERIC) may 
operate at near 1.2 GFLOP rate 

• Major problem was I/O 

- inadequate bandwidth 

- data set partitioning 

• 2K instruction cell memory too small 

• VAL compiler directives may be difficult to 
write 

• Since machine is single user I/O wait time 
cannot go to another job 

• Fewer, higher— performance PEs 
recommended 


Natural Language Processing 




Answer 


NLU - Natural Language Understander 
Structure of Natural Language Processor 
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f^ind ^ Find Instantiate 

Verb Structure Structure 



Natural 

Language 


Structure of the NLU VAL Program 
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Findings 


• Lack of global databases a significant problem 

• Lack of high-level support for I/O 

• New algorithmic approaches must be devised 
that readily exhibit parallelism 
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Queueing Network Models 

• A tool for deriving performance estimates for 
computer systems and communication 
networks 

i 

I 

• Compute performance measures such as 

throughput, response time, utilization, average i 
queue length i 


Findings 

• Practical considerations limit useful problem 
sizes to those that can be solved interactively 
on sequential computers 

• Approximate techniques suffice for very large 
problems 

• The most parallel algorithm did not lead to 
efficient parallel code due to fan— in/fan— out 
restrictions 
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What We Learned 

• VAL readily learned 

• Data flow model of computation readily 
learned 

• Most applications could use all parallelism 
available 


Smaller machines may be quite cost effective 


VAL programming environment must improve; 
debugging support 

Efficient sparse matrix handling may require 
hardware support 

Array memory bandwidth should be increased 

Array memory size should be increased 

Bandwidth for disk I/O should be increased 

Appropriate number of PE logic units difficult 
to assess 
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Benefits of Study 

• Broken some of the resistance of users to 
look at new computer architectures 

— strong effort made by team members 

• Computer scientists working with users 

— machine and language design changes 

• Knowledge on how to conduct future studies 

— other combinations of 
model/machine/applications 
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Computer Architectures for Computational Physics 
work done by 

Computational Research and Technology Branch 

and 

Advanced Computational Concepts Group 
Ames Research Center 


The following slides describe the importance of having high performance 
number crunching and graphics capability. They also indicate the types 
of research and development underway at Ames Research Center to ensure 
that, in the near-term, Ames is a smart buyer and user, and in the long- 
term we know what the best possible solutions are for our number 
crunching and graphics needs. 

The drivers for this research are real computational physics applications 
of interest to Ames and NASA. We are concerned with how to map the 
applications, how to develop the optimal system software and system 
architecture, and how to maximize the physics learned from the results 
of the calculations (which at the present time means graphics). We are 
utilizing a group of DEC and CRAY manufactured MIMD architectures, 
various simulation tools for larger MIMD architectures, and also plan to 
utilize various versions of the Hypercube architecture. To control flow 
we are looking at simulations and prototypes for the study of data flow 
and systolic architectures. At present, it is a competition between the 
three architectures to determine which one will hold the most promise for 
the early 1990s. Once we have discovered which one (or two) hold the 
promise we will concentrate our computer science R&D in that area. 

The computer graphics R&D activities are directed at getting maximum 
information from our three-dimensional calculations by utilizing the 
real time manipulation of three-dimensional data on the Silicon Graphics 
IRIS Workstation. We are also working on new algorithms which will 
permit the display of experimental results, which are sparse and random, 
the same way we display computed results, which are dense and regular. 
This would permit the synergistic coupling of computational and experi- 
mental techniques. 
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Related Research and Development 
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start with "real" complete applications 
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Computer Graphics 


Algorithms of Interest 






c 

o 


<0 

N 


B 

o 

<0 

u. 

o 

(D 


£ 



lan 

O 



CO 

a; 


0 

4-< 

<0 


u 

.£ 


> 

ra 


Q 


CO 


QC 

< 


■o 

a; 

O) 

ro 

u 

Q 




C 

o 

N 


o 

CO 

U- 

Q) 

#■» 

fO 



■ an 

O 

■ an 


CO 

UJ 



CL 

E 


! 


1-206 


Large Eddy Simulation Utilizing Spectral Methods 


Architectures 



CRAY X/MP-48 




















Performance of Multitasking on the CRAY X/MP 
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Performance of Multitasking on the Dual VAX 11/780 
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PPA Architecture 




Circuit-switched Network Simulation 

Motivation and Objectives 

• Understand performance of networks which 
could be used to build high-performance 
parallel architectures 

• Use a real application (LES) from Ames to 
generate data for this study 

• Understand how a real CFD problem could 
map onto a large MIMD architecture 

The Model 

• A circuit switched Omega network serving 
multiple processors connected to multiple 
modules of a shared memory 

• Queues of requests exist at each processor 
port and are served one at a time 

Construction of the Simulator 

© Discrete event simluatlon facility of SLAM 
driven by FORTRAN subroutines 

• Statistics collected on service times 
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Bandwidth of Network for Various Cases 

Three cases: 

• Real data from a CFD code (LES) 

• Random data 

• Infinite vectors with p=1 


Total Bandwidth in MW/sec. 

n 

MAX 

Random 

Vectors 

Actual 

8 

36 

12.5 

5.52 

5.75 

16 

67 

12.2 

5.60 

5.62 

32 

123 

5.12 

5.12 

5.24 

64 

229 

5.76 

4.16 

4.36 


For comparison look at Grays: 


Maximum Bandwidth in MW/sec. 

Machine 

Bandwidth 

Cray 1 

80 

Cray X-MP 

631 

512*512 

1500 
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Conclusions from the Network Simulation 

Modelling network traffic with streams of random 
data can be very misleading since actual codes 
exhibit a very different behavior 

The bandwidth of the network does not increase 
linearly with the number of ports 

A circuit-switched network such as this is far too 
slow to be useful for building high-performance 
MIMD architectures 
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System Architecture of a Systclic Attached Prccessor 


I 









Static Data Flow \lacliiDe Architecture 




RN Routing Network. 512 by 512, 16 bit data paths, operates at > 
5MHz, average rate of transmitting FP packets 0.25 MHz from a 
single PE to another. 

PE Processing Elements. 5 to 8 MFLOPS with two 1.25 to 2 
MFLOP multipliers. 256 PE’s in the system. 

IS Instruction Store. 1024 cells for FP instructions, 1024 for others. 

AM Array Memory. Size not fuUy determined. At least 256K 64 bit 
words per PE. 

lO Input Output. Includes mass memory, host processor, and 
display systems. 256 paths through the RN are reserved for lO. 
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Status of Data Flow Simulator 
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Questions to be Answered by the Simulator 
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What is the best way to distribute instructions across the processming elements? 
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computational physics applications 


Organization of Data Flow Simulator 
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DRIVER will run on VAX to allow interactive use. TRANSLATOR and SIMULATOR will run on Cray because of length of run. 
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ROLE OF HUMAN IN THE AUTOMATED PLANNING SYSTEM 


The interaction between task planning and execution systems with the "external world" and the 
operator is not widely understood at the present time. Of particular interest is the derivation of 
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THEORY HAS PRACTICAL APPLICATIONS TO DOMAINS WHERE KNOWLEDGE 
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with any degree of certainty. 
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WITH OPTICAL PROCESSOR FRONT-END AND OPTICAL READ-WRITE DISK 
STORAGE, VHSIC SYMBOLIC PROCESSOR COULD POTENTIALLY MEET THE 
NEEDS OF ALL PROJECTED SPACE STATION AUTOMATED SYSTEMS AND 
SCIENTIFIC EXPERIMENTS. 
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ADDRESSABLE MEMORY CHIP COULD BE CRITICAL ELEMENT IN 


An efficient method for translating optical information into symbolic 
representation is not known at this time. This issue will need to be resolved 
hofnrp thp <vmhnlir nrocessor can interact in real-time with the symbolic 
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correlation of performance data between different machines and permit 
identification of architectures which are most efficient for specific 
applications. Tradeoffs between architectures can also evaluated using a common 
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CIRREHT PROBLEMS WITH EXPERT SYSTEMS 


0 MRXR PROBLEM IS DEVELOPMENT TIME AND COST - WITH THE SPACE STATION. j 
ADDITIONAL PROBLEM IS THE HIGH RELIABILITY REQUIRED | 

0 LACK OF TRAINED PEOPLE - SEVERAL UNTRAINED "EXPERTS" CURRENTLI^, IN . j 
EXISTENCE ; ; 

■ : x';' • ■ ■: 

‘ ' • i. *• --w' , - . • .< 

0 DEVELOPMENT OF SUITABLE REPRESENTATIONS FOR EACH DOMAIN 

0 BETTER HARDWARE WILL NOT HELP MUCH ’ ’ 

' 0 TRAINED AI PEOPLE REQUIRED ' • 

0 EXPERT SYSTEMS FOR COMPLEX DOMAINS AT LEAST 15 YEARS AWAY 


0 LONG-TERM PERFORMANCE LIMITATIONS 

V o LACK OF ABILITY TO LEARN : f ' 

•'V o DIFFICULTY OF DOMAIN KNOWLEDGE REPRESENTATION 
<■1 0 TEMPORAL ANO GEOMETRICAL REASONING ABILITY ; 


■i 

- i:r, u , .J /S ^ • , 


. I, - ^ u uirriwucii ur lA^nnin nhuhlluul iun ■ - : 

' , 0 TEMPORAL ANO GEOMETRICAL REASONING ABILITY ; ,i 

■;V;V -v-: ■• d. 

V> 0 INADEQUATE LONG-TERM RESEARCH PROGRAM/FUNDING AND TRAINED KNOWLEDGE 


V ..ENGINEERS . : ‘ .V-' • ; V V' 

^Vit '-O PROVIDE INCREASED FUNDING FOR STUDENTS AT MOOR AI UNIVERsVtIES 

W. ® PROVIDE COOPERATIVE RESEARCH ENVIROIWENT FOR TRAINING OF IN-HOUSE ^ 

• PERSONNEL '.s- :;':’ ' 

0 PROVIDE FUNDS FOR RESEARCH IN EXPERT SYSTEMS V\ 

H PROVIDE SUPPORT FOR. PROVEN EXPERT,. SYSTEM^ KVELOPMENT JEAMS ^^^^^ 

.•^‘u »■ - 

■■ . ■ . V" 'i . ■ '-I,;; > ■ • t, ■ ^ -I ^ 
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PRESENT LIMITATIONS OF EXPERT 
SYSTEMS 


Knowledge representation. 

Reasoning. 

Knowiedge acquisition facilities. 
Verification. 

Expianation capabilities. 

Metaknowledge. 

Learning Capabiiity. 

3 
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P reject : 


Knowledge Representation and Knowledge Acquisition 


Part i c 1 pants ; Henry Lum, SI 

Claire Wolfe, SI 

Bruce G. Buchanan, Stanford University 

Status: Work in progress 

Grant 

Project Description; 

3y working on PROTEAN, an expert system which determines the 
wliree-d 1 mens Iona 1 molecular structure of a substance from HMR (nuclear 
iiiagnetlc resonance) data, the blackboard model BBl, which is a framework 
ror knowledge representat 1 on and control, is examined. 

Reference ; 

Clancey, W.J.: "Acquiring, Represent 1 ng , and Evaluating a Competency Model of 

Diagnostic Strategy", Stanford HPP Report 84-2, February 1984. 


25. 

Project: Reasoning With Uncertainty 

Partic ipants: Henry Lum, SI (grant monitor) 

Lotfl Zadeh, U.C. Berkeley 

Status: Work In progress 

Grant 

Project Description: 

"Fuzzy Logic" Is one way to handle uncertainty In reasoning. This 
project focuses on the further development of fuzzy logic. 

References : 

Zadeh, L.A.: "A Computational Theory of Dispositions", Proceedings of the 

1934 International Conference of the Association for Computational 
L 1 ngu 1 st 1 c s . 

Zadeh, L.A.: "Test-Score Semantics as a Basis for a Computational Approach to 

the Representation of Meaning", U.C. Berkeley Memorandum No. UC3/ERL M34/8, 
January 1934. 


27. 

P reject : 
Partic i pants : 

Status : 


Fuzzy Rule-Making for Failure Detection and Expert Systems 

Henry Lum, SI (grant monitor) 

Tom Sheridan, MIT 

V/ork In progress 
Grant 


Project Description: 

This project will investigate the use of fuzzy logic In diagnosis of failures 
in complex space systems. 
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28. 

Project : 

Part Ic 1 pants : 


Syst.m Procedural Knowledge Engineering Toole 


Henry Lum, SI 
Mike Georgeff, SRI 


Status : 

Project Description ; 


Work in progress 
Contract 


•Active Intelligent systems need to be able to represent and reason 
about actions and how those actions can be combined to achieve given 
goals. ^HIs knowledge is often in the form of sequences of actions or 
procedures for achieving given goals or reacting to certain situations. 


Cln the tools being developed! the knowledge representat i on has a 
declarative semantics that provides for Incremental changes to the 
system, rich explanatory capabilities, and verifiability. The scheme 
also provides a mechanism for reasoning about the use of this knowledge, 
thus enabling the system to choose effectively between alternative 
courses of action." 


Reference : 


Georgeff, M. : “Development of an Expert System for 
Knowledge", contract report, December 1984. 


Representing Procedural 


29. 


P roject : 


Information Understanding 


Part ic 1 pants : 


Status : 


Henry Lum, SI (grant monitor) 
Richard Volz, U. of Michigan 

Work in progress 
Grant 


Project Description; 

Under a grant to the University of Michigan, Richard Volz is Investigating 
the integration and fusion of sensor information for use by expert systems. 
It is hoped that this research will contribute to space-borne robotics 
appl icat 1 ons . 


30. 


Project; Symbolic Processor Architectures 

Participants: Henry Lum, SI (grant monitor) 

Edward A. Feigenbaum, Stanford University 

Status: Work in progress 

Grant 

Project Description; 


This long-term project 
architecture which can 
performance . 


undertakes to develop a symbolic processor 
equal or surpass a fifth generation computer 


i n 


References : 


1983: Circuit Design', Stanford HPP Report 83-45. December 


D i etter i 
Stanford 


“>-earnlng About Systems that Contain 
HPP Report 84-10, May 1984. 


State Variables", 
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31. ORIGINAL 

Inference Engine Evaluation OF POOR 

Claire V/olfe, SI 
Raf ao 1 V 1 1 1 egas , S I 
Vivian Frederick, De Anza College 

Work in orogress 
In-house 

Project Description: 

■The strengths and weaknesses of several existing Inference engines (such 
as MRS, EMYCIN, AGE, 0PS5) are being evaluated for various types of 
applications and appropriate Inference engines are being maintained for 
use throughout NASA. An intra-agency class will be conducted this 
summer (1935) to familiarize people witn the Symbolics Lisp Machine and 
available expert system building tools." 


Project: 

Part i c 1 pants : 

Status : 


PAGE IS 23 

QUALITY 


32. 


P roject : 

Part i c i pants : 


Status : 


Robotics Perception Laboratory 

Scott Starks, University of Texas 
Veena Bhatia, S! 

Harold Fu j i i , SI 
Raj i V Mehta , F SN 

Work in progress 
In-house 


Project Description: 

An experimental robotics laboratory is being established to test various 
sensor hardware and software for robot perception systems. Laboratory 
and educational robots are being acquired to equip the lab. This work 
\/ill contribute information needed for determining requirements and 
specifications for the SMART program (see applications project 9). 


33. 

Concept Design of Intelligent Iconic Processors 
Wun Ch i ou , SI 

Carolyn Banda, SI (Informatics) 

Planning stage 
In-house 

Project Description: 

The goal of this project is to develop a translation between symbolic 
representat i on of information and representation by icons. This work will be 
oone on a Symbolics, and will make use of Easy Graph, a Lisp tool developed 
in-house to draw polygons and various other geometric figures. 


.P roject : 

?3 rt i c i pants : 

Status : 


3 4 . 

Project: Knowledge Representation of an Executive Expert 

System Controller 

Pa rt i c i pants : Wun Chiou, SI 

Bruce G. Buchanan, Stanford University 

Status: Planning stage 

Grant, in-house 

Project Description: 1-247 

This project will undertake an In-depth look at the knowledge 
representation involved in the control of the space station expert 
sub-systems . 
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Al AT AMFS 


Rufnors of artificial intelligence (AI) activity at NASA Ames have been floating 
around for some time. To the relief of those of us here at Ames attempting to 
work In A!, those rumors have not been greatly exaggerated, and. in fact, the 
discovery of such a quantity and diversity of planned and on-going projects 
exceeded all expectations. To promote cooperation among scientists and 
better-informed planning in management, this document was conceived and 
prepared. Several months were required to gather and organize the project 
descriptions contained herein. It is hoped that the effort expended initially will 
make future updates easier to prepare. 

fhis document contains three principal types of Information, in this order 

1. charts of function versus domain for Al applications 
and interests, and research area versus project number 
for AI research 

2 a list of project titles with associated project numbers 
and page numbers 

3 project descriptions, including title, participants, and 
status 


In particular, the chart for Al applications and interests is an attempt to present 
information in such a way that 

1. function commonality across domains is shown 

2. the amount and type of work in a particular domain is 
seen at a glance 

3. blank regions are easily detected and evaluated for 
possible future work 

Feedback on this presentation is requested and will be appreciated. 

Many thanks to all of the scientists and engineers at Ames who contributed 
project descriptions. Their work made this document necessary - their patience, 
help, and encouragement made it possible. 


Alison Andrews 
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Domain 




Prediction 



Al Applications 


Space Science Eartn Resources ; Aeronautics 


Human Life Sup 
Factors /Medicine 


Remote ' Aircraft • 
Sensing | Systems 1 




For function descriptions, see reverse side 1~255 











































Al AT AMES 


The following function categories and their descriptions are from Table i.l, p.l4 
of Building Expert Systems, edited by F. Hayes-Roth, D. Waterman, and D. Lenat. 


• PREDICTION - Inferring likely consequences of given situations 
(eg. military forecasting, traffic prediction, weather) 


INTERPRETATION - Inferring situation descriptions from sensor data 
(eg. speech understanding, image analysis, signal interpretation) 

DIAGNOSIS - Inferring system malfunctions from observables 
(eg, medical, electronic, mechanical, software) 

DESIGN - Configuring objects under constraints 
(eg. circuit layout, building, budgeting) 

PLANNING - Designing actions 

(eg. robot, route, communication, military, project) 

MONITORING - Comparing observations to plan vulnerabilities 
(eg. nuclear power plant, air traffic, disease) 

CONTROL - Interpreting, predicting, repairing, and monitoring system 
behaviors (eg. air traffic control, battle management, mission control) 

DEBUGGING - Prescribing remedies for malfunctions [planning, 
design, prediction] (eg. intelligent knowledge base and text editors) 

REPAIR - Executing a plan to administer a prescribed remedy 
(eg. automotive, avionic, and computer maintenance) 

INSTRUCTION - Diagnosing, debugging, and repairing student behavior 
(eg. intelligent computer-aided instruction) 
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Research Area 


Human Perception, Cognition 


Human-Machine interaction 


Machine Vision, Perception 


Machine Architectures 


. LAtj OV^LiUi!, tjnuc; QLanvjHiy 


Reasoning 


Knowledge Representation 


Planning and Problem Solving 


Learning 


Natural Language 


Automatic Programming 


Expert System Building Tools 


Al Research 


Projects 


25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 




Category 

Al Books 

General Al 

41 

Expert Systems 

42 






















Al AT AMES 


1. Automatic Detection of Procedural Errors 

2. SMART CHECKLIST for Aircraft and Spacecraft 

3 Army-Aircrew-Aircraft Integration Program (A^\ ) 

4 Expert System for Pilot Training (A^l) 

5. Plant Control and Failure Diagnosis 

5 QRS Operator Advisor 

7. Automatic Control of CELSS 

8 Aerospace Medicine 

9 SMART Program 

1 0. Infrared Data Examination and Analysis Expert System 
^ 1 Kuiper Airborne Observatory Flight Planner 

12. Halley's Comet Observation Scheduler 

13. SIRTF Scheduler 

1 4. Aerosol Particle Imag e Classifier 

1 5. Remote Sensing Jmaae Classification 

1 6. Imag g-gas^d Geological Exploration 


Qiif: 


9 

9 


10 


to 

to 


tt 

tt 

It 

12 

12 


13 

13 

14 

14 

15 
15 
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Al AT AMES 


















Al AT AMES 


S 

w w . 

ConceDt Desian of Intelliaent Iconic Processors 

23 

34 

Know. Rep. of an Executive Expert Svstem Controller 

23 

35 

Computational Models of Human Vision 

24 

35 

Pilot-Cockpit Interface Desian 

24 

37 

information Processinq_Mo.dels 

24 

TO 

yo 

Aircrew Cockpit Communications 

25 

39, 

Expert Systems Research 

25 

40. 

Natural Lanauaae Research 

26 

4| 

Book - Intelliaent Machines 

27 

42 

Book Chapter - Knowledae-Based Systems for CFD 

27 

43 

Pilot Aids 

29 

44 

Optimal Diaanostic Techniques 

29 ! 

45. 

Al / Numerical Optimization Intearation 

i 

29 

46. 

Machine Learnina. CAI 

29' 

47. 

Aj Languages. Operatina Systems 

1 

29 1 
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LIFE SCIENCE 


HUMAN FACTORS 


1 . 

Project: Automatic Detection of Procedural Errors 

Part 1 c 1 pants : Everett Palmer, LH (grant monitor) 

John Hammer, Georgia Tech 

Status: Work In progress 

Grant 

Project Description: 

“Under a grant to Georgia Tech, Dr. John Hammer has developed a 
computer program (PLANE) which can automatically detect procedural 
errors made by an aircraft crew. The program Is based on Schank's 
[Roger Schank of Yale] concept of scripts. The flight is structured as a 
four-level tree consisting of mission, flight phases, procedures and 
actions. Each node In the tree can be In one of four states (unstarted. 
Inprogress, done, or aborted). As actions occur during the mission, the 
state of the tree is updated and erroneous actions are called out. 

During the coming year this program will be applied to data from a full 
mission simulation In the B727 simulator at Ames.* 

Ref erence : 

Hammer, John : "An Intelligent Flight Management Aid for Procedure 

Execution", IEEE Transactions on Systems, Man and Cybernetics, In press. 


2 . 


Project: 
Partlc ipants: 


SMART CHECKLIST for Aircraft and Spacecraft 

Everett Palmer, LH 
Ed Lee, LH (Informatics) 


Status : 


Work In progress 
In-house 


Project Description: 

"At Ames we are incorporating concepts from John Hammer's program Into 
the design of a SMART CHECKLIST program. The goal of the SMART 
CHECKLIST Is to aid the operator of aircraft and space craft systems In 
executing procedures. The program will also monitor for procedural 
errors made by the operator. This project will combine concepts from 
rule based models of human behavior, AI theories of story understanding, 
and syntax directed editors used In software development environments. 
The space shuttle payload that we have chosen to Investigate Is the 
Orbiting Refueling System (ORS).“ 
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Project: Army Aircrew-Aircraft Integration Program (A^I) 

Participants: Irving Statler* Y 

David Nagel, LH 

Earl 0 . Hartzell, LHAC 

Status: Work In progress 

I n-house, contract 

Project Description: 

"[This] activity is a new one that the Aeromechanics Laboratory has 
undertaken jointly with NASA’s Aerospace Human Factors Research 
Division. This ambitious endeavor, called the Army A 1 rc rew-A 1 rc raf t 
Integration (A^I) Program, will attempt to develop a validated 
methodology for predicting the pilot behavior In a single-seat 
scout/attack helicopter. The model Is Intended to be used for helping 
engineers account for the design of cockpits and training systems. We 
have Initiated some discussions with representatives from Stanford 
University about the possibility of developing an ’expert system* that 
might be useful as a checkpoint In the process of validating the human 
model • In the meantime, we may also be developing some expert systems 
for controlling opponent aircraft In simulations of air-to-air combat." 


4. 


Project: 

Part 1c ipants : 


Status : 


Expert System for Pilot Training (A^I) 

Wun Chlou, SI 
William Gevarter, SI 

Bruce G. Buchanan* Stanford University 

Work In progress 
In-house, grant 


Project Description: 


This project Involves the development of an expert system which Is 
capable of transferring an Instructor pilot's knowledge to a student 
pilot. The system must be able to learn In some sense, so that a model 
of the student's knowledge can be formed. 


5. 


Project: 


Plant Control and Failure Diagnosis 


Part 1c Ipants : 


Status: 


Everett Palmer, LH (grant monitor) 
Bill Rouse, Georgia Tech 
Annette Knaeuper , Georgia Tech 

Work In progress 
Grant 


Project Description: 


Under a research grant to Georgia Tech, Or. Bill Rouse and Annette 
Knaeuper have developed a rule based model to describe the behavior of 
the operator of a generic process control plant. The model, named KARL, 
controls the plant and diagnoses plant failures. The design goal of 
KARL was to develop a model that could balance the competing demands of 
controlling the plant with needs to cope with failures. During the past 
year they have modified the model so that It provides advice to the 
plant operator. During the coming year this model will be extended to 
the description of operators controlling space shuttle payloads.* 
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Part 1c Ipants : 

Status: 
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ORS Operator Advisor 

Guy Boy, LH ( ONERA-CERT-DERA ) 
Will Taylor, LH (Informatics) 

Work In progress 
In-house 


Project Description: 

■Dr. Guy Boy from ONERA-CERT-DERA In Toulouse, France Is visiting our 
group CLH] for a year. He has developed rule based models to model crew 
performance in aircraft cockpits. His project at Ames will be to 
develop an expert system (HORSES) CHuman-Orb 1 ta 1 Refueling System Expert 
System] to advise the operator of the Orbiting Refueling System during 
system malfunctions. He Is basing this system on a system he developed 
In France to aid the operator of a geosynchronous satellite. He has a 
first version of the HORSES system operating on our CLH] VAX 750. It Is 
programmed in Franz Lisp." 


LIFE SUPPORT / MEDICINE 


7. 

Automatic Control of Closed Environment 
Life Support Systems (CELSS) 

Sllvano Colombano, LXL 

Planning stage 

Some In-house, most probably contract 
Project Description: 

■A typical operational CELSS module, as presently envisioned, will 
provide life support, at least in part, to a crew of astronauts, in the 
form of breathable air and food. It is not envisioned, however, that 
the crew should spend a substantial amount of their time tending the 
system. The ideal CELSS will be largely self-sufficient, will recognize 
and maintain the state or sequence of states that are necessary to 
fulfill its function. It will detect problems, attempt to provide a 
diagnosis, select a course of action for self-repair, or at least 
suggest one. The reason for this Is that the system will certainly be 
extremely complex, and the crew cannot be expected to have mastered its 
i ntr i cac 1 es . 

For self-regulation this system will need software that Integrates 
aspects of AI, simulation and process control. It will have to be 
completely reliable and run on equally reliable and compact hardware. 

Vyhile still keeping the need for Increasing integration in mind, 
separate areas of software development have been listed: Simulation, 

expert Systems, Computer Vision, Robotics, Computer Aided Design and 
Computer Aided Process Control.* 


Project : 

Part 1c i pants : 
Status : 


8 . 


Project: Aerospace Medicine 

Participants: James Stevenson, LH 

Status: Planning stage 

In-house 


Project Description: 

With a background in experimental psychology and biostatistics, Dr. 
Stevenson is exploring the possible use of export systems In aerospace 
med i c. \ n<* . 


SPACE SCIENCE 


SPACE STATION 





9. 

Project: SMART Program (Space Missions for Automation and 

Robotics Technologies) 

Partic Ipants: Henry Lum, SI 

Status: Planning stage 

I n-house 

Project Description: 

"The SMART Program Is proposed as a multi-flight Shuttle-based Automation and 
Robotics Test Facility for the validation of advanced robot1cs« automation* 
and telepresence technologies and real-time operational concepts. The 
Facility will offer the potential for evaluating ‘standard’ operational 
environments for robotics and automation applications. Technology and the 
over-all system capability will be upgraded periodically by the Ames 
Cooperative Research Team consisting of researchers from Ames* Industry, and 
academ i a . 

The necessity of a space flight Is dictated by the constraints imposed by 
space such as remoteness* zero-G, and ‘hostile' environment. It Is planned 
that all Facility experiments will be evaluated prior to flight In NASA's 
ground test facilities such as MSFC's Neutral Buoyancy Facility. This 
procedure will maximize the potential for a successful flight. Complexity of 
the flight experiments will progress from RMS-attached robots to supervisory 
tethered robots to free-flying multiple robots working in a controlled 
distributed environment towards a common work objective. Telepresence mode 
Is feasible for the latter.** 


ASTRONOMY 


10 . 


Project: 

Part Ic 1 pants : 


Status : 


Infrared Data Examination and Analysis Expert System 

Paul Swan* SST 
Oeffrey Scargle* SST 
William L Ikens* LXR 

Robert Mecklenburg* SST (Informatics) 

Gary Vlllere, SST ( I nf ormat Ics ) 

Mike Werner, SSA 

Work In progress 
In-house 


Project Description: 

**The primary effort of this project has been In the conceptual design of 
an Infrared Data Expert Assistant (IDEA) computer program which would 
utilize expert system techniques to assist the Infra-red astronomer In 
the examination and analysis of the very large set of data which Is now 
oeing made available from the IRAS program. “ 

The program will Incorporate: 

Command Language Interface (“being developed by using the LEX and 
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YACC programs provided as part of the UNIX operating system on the VAX") 

- Data Base Management System <",..has been Implemented by buying a 
commercial data base management system available for the VAX computer, 
and entering Into it the data from IRAS, as well as astronomical 
catalogs obtained on magnetic tape from the Goddard Space Flight 
Canter . “ ) 

- Expert Infrared Astronomy Knowledge ("...a set of rules of the form 
I F . . . THE »'l . . . concerning 1 nter pretat 1 on of the IRAS data, as well as two 
specific search procedures for solving the problem of Identification and 
classification of the IRAS point sources.") 


11 . 


P rojcct : 

Part 1 c i pants : 


Status : 


Kuiper Airborne Observatory Flight Planner 

Philip Nachtshelm, SI 

John Stutz , SI (Informatics) 

Carolyn Banda, SI (Informatics) 

William Gevarter, SI 

Work nearly completed 
I n-house 


Project Description: 


A computer prcgrain named KAOS (Kuiper Airborne Observatory Scheduler) 
has been developed to perform flight planning. "The basic mode of 
operation of KAOS Is generate and test, that Is, a leg Is calculated for 
the observation of an object and then tested. Typically an observation 
is rejected If (1) the object Is outside of the window, (2) the leg 
overflies a restricted zone, (3) the leg overflies a warning zone, or (4) 
the completion of a leg leads to a point out of range. These rules can 
be relaxed by the user, and other rules can be added. In a sense, the 
system can be ’trained'." 


"The essential features of the expert system are the data base, rule 
base, and Inference engine: 

- data base: catalog of objects and ephemerls data 

geographical locations of warning and restricted zones 
flight departure points. 

- rule base: if. ..then... (or situation-action) rules 

“ inference engine: MRS, or Meta-level Reasoning System, written In 
LISP and developed at Stanford University" 


Reference : 

Banda, C., Stutz, 0., Nachtshelm, P., Gevarter, W. : "User's Guide for 

KAOS", November 1984. 


12 . 

Halley's Comet Observation Scheduler 

Oohn Stutz, SI (Informatics) 

Wun Chlou, SI 

Work nearly completed 
In-house 

Project Description: 

This expert system schedules observations in the KAO for the fly-by 
of Halley’s Comet. The system is an extension of the KAOS system 
(described previously). The similarity of the application allov/s the 
use of the KAOS structure with only minor modifications. The knowledge 
base has been modified for the new application. 


Project: 
Partic Ipants: 

Status : 
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13 . 

Project: SIRTF Scheduler 

Participants: Philip Nachtsheim, SI 

Status: Planning stage 

In-house 

Project Description: 

This project will develop an expert system to schedule the observations 
for the Shuttle Infrared Telescope Facility. The KAOS system will serve 
as the foundation for this system. 


EARTH RESOURCES 


ATMOSPHERIC RESEARCH 


14. 

Project: Aerosol Particle Image Classifier 

Part 1c i pants : Libby Netland, SI 

Scott Starks, University of Texas 

Status: Work in progress 

In-house 

Project Description: 

“[The Aerosol Particle System (APS) Is] a developmental system which 
will use expert system building techniques to automate the 
classification of sulfuric acid particles. This will function as an aid 
to stratospheric aerosol research. Each month, a U-2 aircraft collects 
sulfuric acid samples by exposing palladium wires to the stratosphere at 
70 ,jDj 0T0 ft. elevation. These wires are then photographed under a 
Scanning Electron Microscope. The photographs are examined by one of 
tlio aerosol researchers, and the sulfuric acid particles are counted and 
sized. Since the photographs are taken at a high magnification, flaws 
and dark spots appear which must be discriminated from the sulfuric acid 
particles. For this reason, traditional particle counting systems are 
1 nadequate . 

The APS software uses similar Isolation techniques and numerical 
feature measurements as those used in traditional Image Classifiers. 
However, once the feature measurements are known, they are related 
symbolically rather than numerically to choose the correct 
classification for the unknown object. The APS data base contains rules 
about predefined objects instead of numerical statistics about the 
objects. One advantage of having a symbolic rather than numeric 
representation Is that the system can be easily modified by adding 
rules . “ 

Reference: 

Starks, S., Netland, E., and Elizandro, D.: "Analysis of Aerosol Particles 

by Digital Image Processing Techniques", 1984 ASEE Annual Conference 
Proceedings, p. 1335. 
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15. 

Projects Remote Sensing Image Classification 

Part 1c ipants: William Likens, LXR 

William Erickson, SI 

Steve Engle, LXR (Informatics) 

Status s Work in progress 

I n-house 

Project Description: 

“Tlie problem selected for this demonstration Is that of automated 
libeling by land cover of spectral clusters developed through 
unsupervisod clustering of Landsat Mu 1 1 1 -Spec tra 1 Scanner (MSS) Imagery. 
Tho prototype Is to label spectral clusters for Level I Information; 
namely, urban, forest, range, water, barren, and ‘other*. This problem 
13 well suited for expert system analysis in that, 1) tiie set of 
possible solutions is clearly defined, and 2) the problem Is well 
understood and routinely solved by image analysis professionals. 

Inputs to the prototype system will consist not only of MSS spectral 
statistics, but also collateral data. These collateral data may include 
digital terrain, zoning, prior land cover maps, and other data. Data 
are to be statistically summarized when Input Into the system In order 
to reduce their volume and complexity. 

The concept for the mature system emphasizes minimal Inputs from the 
user with an emphasis upon use of a dedicated expert system processor, 
sucli as a Xerox 1108, linked to Image analysis functions on a larger 
general purppose computer, such as a DEC VAX 11/780." 

Reference : 

Erickson, W.K., and Likens, W.C.: "An Application of Expert Systems 

lochnology to Remotely Sensed Image Analysis", Proceedings of the Pecora 
9 Symposium, Spatial Information Technologies for Remote Sensing Today 
and Tomorrow. IEEE, October 1984. 


1 3 . 

Project: Image-Based Geological Exploration 

Partic ipants: Wun Chlou, SI 

Status: Work completed 

In-house 

Project Description: 

An image-based expert system for geological exploration was developed by 
\/un Chiou while he was at JPL. 

Reference : 

Cliiou, W. : "System Architecture of a Remote Sensing Expert System", 
Proceedings of the IEEE Computer Society Workshop on Computer 
Architectures for Pattern Analysis and Image Data Base Management, 
P24O-250. 
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Project: Conceptua 1 /P re1 1 ml nary Design of Aircraft 

Participants: George Kidwell, FHS 

Megan Eskey, FHP 

Status: Work in progress 

In-house, possible contracts 

Project Description: 

"The ultimate goal of this project is the development of an Integrated 
system capable of greatly assisting the advanced aircraft designer in 
achieving the optimal configuration based on requ 1 rements , constraints, 
and available technologies. Such a system will necessarily be a hybrid 
using many computer programming and analytical techniques, such as 
knowledge-based expert systems, numerical optimization, parametric 
approximation, design synthesis, and several levels of analysis 
algorithms. The driving rationale behind this project is based on the 
increasingly divergent design goals of high performance (speed, 
manouverab i 1 i ty , revenue, quietness, etc.) and economy (cost, 
maintenance, size, noise, etc.). In other words, a g 1 oba 1 1 y-opt i ma 1 
solution is required, but it is subject to many diverse constraints and 
must be found in a very large design space. 

The general concept is to employ a knowledge-based expert system to act 
as the design expert and executive for the network of methods. At the 
next level would be a numerical optimization program to deal with those 
variables that are continuous and finite. Beneath this would be a 
heirarchy of synthesis and analysis programs that would be selected at 
appropriate times by the expert system. A database manager is necessary 
to interface with the user 'and the many diverse elements of the system. 
Finally, such a system must be able to network automatically (or 
scm 1 -automat 1 ca 1 1 y ) among the most appropriate computers for the 
analysis currently being used." 


13 . 


Project: Single Crew Scout/Attack Helicopter 

Participants: Irving Statler, Y 

David Key, YC 
Loran Haworth, YC 
Edwin Aiken, FSOC 
Earl 0. Hartzell, LHAC 
James Voorhees, LHA 

Status: Planning stage 

In-house 

Project Description: 

“The A i rc rew-A i rc raf t Systems Division of the Army Aeromechanics 
laboratory is Interested In applications of artificial intelligence 
which would make feasible the fielding of a single-crow combat 
helicopter. Applications of expert systems, natural language 
processing, computer vision, and problem solving and planning to both 
the f 1 ight path control and mission management crew functions are 
required to reduce the single pilot's workload to a reasonable level in 
the combat environment. The Aircrew-Aircraft Systems Division includes 
‘exports* in the fields of flight control /hand 1 i ng qualities and 
engineering psychol ogy /human factors." 
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19 . 


Project: Real-Time Applications of Export Systems 

Part 1c 1 pants : Lee Duke, OFDC 

Victoria Regenie, OFDC 

Status: Work In progress 

In-house, contract, university grant 

Project Description: 

"The cockpit of a modern high performance aircraft is an exceedingly 
complex Interface between a human pilot with limited resources and an 
avionics system and aircraft of almost limitless complexity. The pilot 
is often required to perform multi-item tasks, using mutiple controllers 
in conditions of high stress and extreme danger while monitoring the 
health and status of an avionics system consisting of numerous sensors, 
weapons, and computers. The pilot Is virtually saturated visually and 
manually. The problem facing the systems engineer is either to simplify 
the system or simplify the interface between the pilot and the vehicle. 

The ultimate goal of the Ames Dryden research and development in expert 
systems is the intent driven cockpit. The research and development 
loading to this goal has been partitioned Into several areas to allow an 
orderly development process with intermediate goals and useful 
products . 

- Flight System Monitoring Functions 

- Expert Control Systems 

- Pilot's Associate 

The Ames Dryden research and development in real-time applications of 
expert systems is Intended to concentrate on applications rather than 
basic research in expert systems. However, the goal of this activity is 
both to develop useful expert systems and to focus on fundamental issues 
that can be pursued by others involved in basic research. 

Two sub-activities are being pursued, both under the auspices of the 
Pilot's Associate segment of DARPA's strategic computing Initiative. 

The first is an expert flight systems monitor for the X-29A Forward 
Swept Wing Aircraft. The second is a closed-loop, goal seeking system." 

Reference : 

Rcgenie, V.A., and Duke, E.L.: "Expert Systems Applications to Failure 

Modes and Affects Analysis, Testing and Real-Time Monitoring", NASA Ames 
Dryden Flight Research Facility X-29A Internal Document X-84-J^07, June 
19J4. 


25. 


Project: Advanced Integrated Flight Control System Study 

Participants: Dale Mackall, OFM (contract monitor) 

Boeing Military Airplane Company 


Status : 


Work in progress 
Contract 


Project Description: 

"The study is to provide a preliminary design for an advanced aircraft 
by integrating previously Independent aircraft functions, such as the 
aerodynamics, flight control, propulsion, structures, and the pilot. 
The study is to examine the tools and methods available to accomplish 
the design and identify any deficiencies. The study will be assessing 
the tools and methods to be used for the design of the p i 1 ot- veh i c 1 e 
Interface. Boeing Is applying their work from the 'Avionics Expert 
Systems Definition Study' to this task. 


small in-house effort was accomplished to obtain a basic understanding 
of how AI techniques can be applied to the pilot interface. The 
emergency procedures for the electrical and flight control system of a 
fighter aircraft were implemented into an 'expert pilot assistant* 
demonstration using an IBM PC. A NASA TM is in editorial, and a 
demonstration disk is available." 
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Part 1c Ipants : Heinz Erzberger, FSN 

Status: Work In progress 

In-house 

Project Description: 

•In the Aircraft Guidance and Navigation Branch we are applying AI 
techniques to the design of advanced guidance systems for aircraft. 

Current projects involve developing expert based systems for automated 
air traffic control and air-to-air combat.* 


22 . 


? reject: 

Part 1c Ipants : 


Status : 


Verification Testing for Digital Flight Control Systems 

Douglas Ooane. FSN 
Jeremy Salto, FSN 
N. Rajan, FSN (Stanford) 

Planning stage 
In-house 


Project Description: 


"The Advanced Verification and Validation Project (Digital Flight 
Control System Verification Laboratory) Is considering the use of AI 
concepts to develop a verification testing methodology for digital 
flight control systems. Initial planning Indicates that an ‘expert 
system* approach may provide an effective mechanism." 


COMPUTATIONAL FLUID DYNAMICS (CFD) 


23. 


Project: 


Automatic Zonal Grid Generation 


Part 1c 1 pants : 


Status : 


Alison Andrews, STA 

Kristin Hessenlus, STA 

Man Mohan Ra 1 , STA (Informatics) 

Work In progress 
I n-house 


Project Description: 


"Cecause It is usually difficult or impossible to generate a reasonable 
single grid about a general three-dimensional aircraft configuration, a 
computational flow field is often segmented Into simpler regions or zones, 
which are then discretized separately. Intelligent zonal grid generation 
requires knowledge about zone criteria, grid generation capabilities, flow 
solver behavior, and expected flow field features. Obtaining a good zoning Is 
important to solution accuracy, efficiency, and ease of grid generation. 

V/ith some guidelines, a CFD expert familiar with the concept of zonal methods 
can come up with a reasonable zoning in two dimensions by ’just looking at' 
the problem's configuration, qualitatively noting shapes, orientations, 
abrupt transitions, relative positions, and other features. However, such 
expertise is not widespread, and it is difficult to express. Furthermore, 
complicated three-dimensional problems present even experts with difficulties 
in the V 1 sua 1 1 zat 1 on and specification of zonal boundary surfaces. Hence 
there is a need to systematize and automate the process of obtaining and 
evaluating a flow field zoning. 

An expert system approach Is a promising one for zoning because it offers a 
v/ay to encode zoning knowledge and manipulate It within a highly 

developmental and extensible framework. A rule-based expert system is being 1-270 
built using MRS, a system building tool (written In Lisp) developed at 
Stanford University. Work Is being done on a VAX 11/780. " 
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Project: 


CFD Expert System 


Participants: Scott Eberhardt, STC 

Rick Briggs, RIACS 


Status : 


Planning stage 
I n-house 


Project Description: 

"The goal of this project is to Implement a deep expert system which 
generates the grid and all necessary parameters for ARC2D (a 
two-dimensional Eu 1 er/Nav i er-Stokes flow solver) given only the 
geometry, along with Mach and Reynolds Numbers. The geometry will be 
interpreted as a combination of 'shapes' which will be abstracted from 
the raw data. The expert system will then work symbolically using only 
the shapes, which will be matched with a hierarchy of shape-frames. 

After the initial phase is completed, we will be examining the 
possibility of the expert system running autonomously in special cases, 
without resorting to ARC2D. If a significant percentage of problems can 
be liandled entirely symbolically (without using a numerical code) this 
will open up an entirely new area of research." 
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25 * 

Knowledge Representation and Knowledge Acquisition 

Henry Lum, SI 
Claire Wolfe, SI 

Bruce G. Buchanan, Stanford University 

Work In progress 
Grant 

Project Description: 

By working on PROTEAN, an expert system which determines the 
three-dimensional molecular structure of a substance from NMR (nuclear 
magnetic resonance) data, the blackboard model BBl, which Is a framework 
for knowledge representation and control. Is examined. 

Reference : 

Clancey, W.O.: "Acquiring, Representing, and Evaluating a Competency Model of 
Diagnostic Strategy", Stanford HPP Report 84-2, February 1984. 


P roject : 

Part 1 c 1 pants : 

Status : 


26. 


P roject : 

Part 1 c 1 pants : 


Status : 


Reasoning With Uncertainty 

Henry Lum, SI (grant monitor) 
Lotf 1 Zadeh , U.C. Berkeley 

Work In progress 
Grant 


Project Description: 


"Fuzzy Logic" Is one way to handle uncertainty In reasoning. This 
project focuses on the further development of fuzzy logic. 

References : 


Zadeh, L.A.: "A Computational Theory of Dispositions", Proceedings of the 
1934 International Conference of the Association for Computational 
L 1 ngu 1 St 1 cs . 

Zadeh, L.A.: "Test-Score Semantics as a Basis for a Computational Approach to 
the Representation of Meaning", U.C. Berkeley Memorandum No. UCB/ERL M34/8, 
January 1934. 


27. 

Project: Fuzzy Rule-Making for Failure Detection and Expert Systems 

Participants: Henry Lum, SI (grant monitor) 

Tom Sheridan, MIT 

Status: Work In progress 

Grant 

Project Description: 1-272 

This project will Investigate the use of fuzzy logic In diagnosis of failures 
in complex space systems. 



28 . 


Project: System Procedural Knowledge Engineering Tools 

Participants: 


Status: 


Project Description: 

"Active intelligent systems need to be able to represent and reason 
about actions and how those actions can be combined to achieve given 
goals. This knowledge Is often In the form of sequences of actions or 
procedures for achieving given goals or reacting to certain situations. 

Cln the tools being developed] the knowledge representation has a 
declarative semantics that provides for Incremental changes to the 
system, rich explanatory capabilities, and verifiability. The scheme 
also provides a mechanism for reasoning about the use of this knowledge, 
thus enabling the system to choose effectively between alternative 
courses of action." 

Reference: 

Georgeff, M. : "Development of an Expert System for Representing Procedural 
Knowledge", contract report, December 1984. 


Henry Lum, SI 
Mike Georgeff, SRI 

Work In progress 
Contract 
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29. 


Project: Information Understanding 

Participants: Henry Lum, SI (grant monitor) 

Richard Volz, U. of Michigan 


Status : 


Work In progress 
Grant 


Project Description: 

Under a grant to the University of Michigan, Richard Volz Is Investigating 
the Integration and fusion of sensor Information for use by expert systems. 
It Is hoped that this research will contribute to space-borne robotics 
appl Icat Ions • 


3J0T. 

Project: Symbolic Processor Architectures 

Participants: Henry Lum, SI (grant monitor) 

Edward A. Felgenbaum, Stanford University 

Status: Work In progress 

Grant 

Project Description: 

This long-term project undertakes to develop a symbolic processor 
architecture which can equal or surpass a fifth generation computer In 
performance. 

References : 

Long, C.: "Framework for Circuit Design", Stanford HPP Report 83-45, December 
1983. 

Dietterich, T.6.: "Learning About Systems that Contain State Variables", 
Stanford HPP Report 84-10, May 1984. 
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31 . 


Project: Inference Engine Evaluation 

Partic Ipants: Claire Wolfe, SI 

Rafael Villegas, SI 

Vivian Frederick, De Anza College 

Status: Work In progress 

I n-house 

Project Description: 

•The strengths and weaknesses of several existing Inference engines (such 
as MRS, EMYCIN, AGE, 0PS5) are being evaluated for various types of 
applications and appropriate Inference engines are being maintained for 
use throughout NASA. An Intra-agency class will be conducted this 
summer (1985) to familiarize people with the Symbolics Lisp Machine and 
available export system building tools." 


32. 

Project: Robotics Perception Laboratory 

Participants: Scott Starks, University of Texas 

Veena Bhatia, SI 
Harold F u j 1 1 , SI 
Rajiv Mehta , FSN 

Status: Work In progress 

I n-house 

Project Description: 

An experimental robotics laboratory is being established to test various 
sensor hardware and software for robot perception systems. Laboratory 
and educational robots are being acquired to equip the lab. This work 
will contribute information needed for determining requirements and 
spec Ificatlons for the SMART prog ram (see applications proj ec t 9 ) . 


33. 

Project* Concept Design of Intelligent Iconic Processors 

Participants: Wun Chiou, SI 

Carolyn Banda, SI (Informatics) i 

Status: Planning stage 

In-house 

Project Description: i 

I lie goal of this project is to develop a translation between symbolic j 

representat Ion of Information and representation by icons. This work will be 
done on a Symbolics, and will make use of Easy Graph, a Lisp tool developed 
in-house to draw polygons and various other geometric figures. 


34. 

• roject. Knowledge Representat Ion of an Executive Expert 

System Controller 

Partic Ipants: Wun Chiou, SI 

Bruce G. Buchanan, Stanford University 

Status: Planning stage 

Grant, in-house 

Project Description: 

This project will undertake an In-depth look at the knowledge 
representation Involved In the control of the space station expert 
sub-systems . 
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Project: 

Participants: 


Status: 
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Computational Models of Human Vision 

Dav Id Nagel • LH 

Albert Ahumada, LH 

Ken Nollsen, LH 

Andrew Watson, LH 

Larry Maloney, NRC 

John Perrone, NRC 

Amy Jo Bllson, U. of Washington 

Brian Wandell, Stanford 

Jack Yellott, UC Irvine 

Work In progress 
In-house, contract 


Project Description: 

“Biological vision Is the only working example of a system capable of 
recognising objects under varying conditions. Vision Is also the 
principal Interface between the human and complex devices such as 
computers, cockpits, and space stations. We are constructing a 
computational model of the early stages In the human visual process. At 
present, we have working modules for processing temporal, spatial, and 
motion components of the visual Input. Future modules will deal with 
stereo and color. The model Is being validated by psychophysical 

AvrvArlmAni^e 4n oiir TKIe mortal will ImnrrMiA rMir* 

W..W— ... w — . . ^ . ....^ 

understanding of human and machine vision, and will guide the design of 
future displays. Interfaces, and Image management systems." 


36. 


P roject : 

Part 1 c 1 pants : 


Status : 


Pilot-Cockpit Interface Design 

Everett Palmer, LH (grant monitor) 

Ken Papp, New Mexico State 

Renate Roske-Hof strand , New Mexico State 

Work in progress 
Grant 


Project Description: 


“Under a grant to New Mexico State, Dr. Ken Papp and Ms. Renate 
Roske-Hof strand are Investigating features of Interface design which will 
maximize the compatibility between the cognitive structures of pilots and the 
way Information Is organized for retrieval In the computer. They have 
developed a methodology based on link weighted networks which derives a 
network representation of how a pilot's knowledge about a specific subject 
domain Is organized. They are applying this approach to the Flight 
Management System's Control Display Unit In the Advanced Concepts Flight 
Simulator at Ames." 


37. 


Project: 

Part 1 c 1 pants : 


Status : 


Information Processing Models 

Everett Palmer, LH (grant monitor) 
Misha Pavel, Stanford University 
Stuart Card, Stanford University 

Work In progress 
Grant 


Project Description: 

“We also have a grant with Drs. Misha Pavel and Stuart Card in the 
Psychology department at Stanford. The objective of their grant Is to 
develop design principles for the use of displays with multiple windows. 

They have used production system like models to describe the Information 
processing operators do when working with a computer. They are using an 1—275 
IRIS graphics system connected to a XEROX LISP machine." 
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33 , 

Aircrew Cockpit Communications 

Miles Murphy, LH (contract monitor) 

Joseph Goguen, Structural Semantics 
Charlotte Linde, Structural Semantics 

Work In progress 
Contract 

Project Description: 

“Under a contract with Structural Semantics, Drs, Joseph Goguen and 
Charlotte Linde have analyzed aircrew cockpit communications as 
linguistic phenomena and developed formalisms showing 'planning' and 
'explaining' to be structured discourse types, described by formal 
rules. These formalisms are integrated with those describing the other 
most Important discourse type within the cockpit: the command and 

control speech act chain. Command and control discourse Is described as 
a sequence of speech acts for making requests (Including orders and 
suggestions), for making reports, for supporting or challenging 
statements, and for acknowledging previous speech acts. 

This work can have application to expert system interface, goal, and rule 
design - whether to ensure natural crew interaction (for near-term 
systems), or possible system understand 1 ng of crew communications (for 
very advanced svstems ) . The formalisms are being further refined on 
data from in-house full mission simulations." 

References : 

Goguen, J., Linde, C., and Murphy, M.: "Crew Communication as a Factor in 

Aviation Accidencs". In Hartzell, E.J., and Hart, S. (eds) "Papers from the 
2Xjth Annual Conference on Manual Control", NASA Ames Researcli Center, 1984 . 

Goguen, J. and Linde, C.: "Linguistic Methodology for the Analysis of 

Aviation Accidents", NASA CR 3741, 1983. 


Project: 

Part 1 c i pants : 

Status : 


39. 

Expert Systems Research 

Rick Briggs, RIACS 

Work in progress 
In-house 

Project Description: 

"A new model of expert systems Is being developed which moves away from 
current rule-based approaches. The rule-based system is viewed as 
incapable of encoding higher level cognitive processes of experts. The 
deep expert system has been proposed, in which the lowest level is an 
EMYCIN-like rule-based system, but which has in addition a series of 
levels of abstraction which include analogical methods and deep abstract 
methodologies which solve from 'first principles' rather than doing 
manipulation of rules on the basis of the syntax of the rules. Rules 
are considered compiled pieces of knowledge which are used for 
convenience.^ A system of semantic primitives has been developed which is 
used at the 'deepest' level of the system. A deep expert system is 
currently being developed in the domain of CFD." 


P roject : 

Part 1c ipants : 
Status : 
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Natural Language Research 
Rick Briggs, RIACS 
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4JJ. 

Project: 

Part ic Ipants: 
Status : 


Work In 
In-house 


progress 


Project Description: 

"A program Is being written to 'understand' (I.e. represent at a level 
equivalently deep to the representation which human beings create when 
they hear or read natural language) simple natural language sentences. 
Sentences are broken down Into very deep representations expressed 
entirely in a set of semantic primitives* and a method of Inferencing Is 
used which allows the program to expect further types of sentences In 
further discourse." 

Also being studied is Sastric Sanskrit, "an obscure untranslated branch 
which functions as an unambiguous automatic Inference-generating 
knowledge representation language." It is a "remarkable natural 
language which is ambiguity and syntax free. The equivalence of the 
language to semantic nets has been demonstrated In 'Knowledge and 
Representation in Sanskrit and Artificial Intelligence', by Rick Briggs, 
to appear Spring 85 in AI Magazine." 
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41 . 

William B. Gevarter, SI 

"Intelligent Machines: An Introductory Perspective of Artificial 
Intelligence and Robotics" 

1985, Prentice-Hall, Inc., Englewood Cliffs, N.O. 

This book provides an easy-to-understand , Integrated view of the many 
diverse aspects of the fields of artificial Intelligence (AI) and 
robotics. It Incorporates a summary of the basic concepts utilized In 
each of the many technical areas; a review of the state-of-the-art; 
research developments and needs; an Indication of the organizations 
Involved; applications; and a 5-lj0T year forecast of emerging 
teciino 1 ogy . " 


42. 


Unmeel B. Mehta, STT 

Contribution of the chapter "Knowledge-Based Systems for Computational 
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CALCITE MINERAL SAMPLE 

SPECTRAL DIMENSIONALITY CAN BE REDUCED WITHOUT LOSING SIGNATURE UNIQUENESS 
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mode -> multiplejpplication 

condition -> >(size(. possibilities) 20) 

action -> [setithresh -(.thresh 2)) eliminate_possibilities()] 
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SPATIAL ASSOCIATIONS OF 
SEGMENTED REGIONS 
RELATIVE NATURAL ABUNDANCE 
OF MATERIALS 
EXPECTATIONS OF THE USER 
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-> calibrate/transform the image. 

-> segment the image into regions of similarity. 
-> display a quantity. 

-> backtrack to a previous step. 

-> exit the session. 
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. segmentation step 


RULE-BASED IDENTIFICATION OF 
SURFACE MATERIALS 
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5) A FINAL COMPARISON OPERATION SELECTED DOLOMITE AS ONE 
OF 3 MATERIALS HAVING SIMILAR SPECTRAL CHARACTERISTICS 
TO THAT OF REGION 4. 
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SOFTWARE LIFE CTCLE DYNAMIC SIMULATION MODEL 
THE OR6ANIZATKRIAL PERFORMANCE SUBMODEL* 
3/1/85 


N87-29 


Robert C. Tauswortbe 
Jet Propulsion Laboratory 
California Institute of Technology 
Pasadena^ CA 91109 



ABSTRACT 

This paper describes the submodel structure of a software 
life cycle dynamic simulation model. The software process is 
divided into seven phases# each with product# staff# and funding 
flows. The model is subdivided into an organizational response 
submodel# a management submodel# a management influence 
interface# and a model analyst interface. The paper concentrates 
on the organizational response model# which simulates the 
performance characteristics of a software development subject to 
internal and external influences. These influences emanate from 
two sources: the model analyst interface# which configures the 

model to simulate the response of an implementing organization 
subject to its own internal influences# and the management 
submodel that exerts external dynamic control over the production 
process. 

The paper provides a complete characterization of the 
organizational response submodel in the form of parametrized 
differential equations governing product# staffing# and funding 
levels. The parameter values and functions are allocated to the 
two interfaces. 
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SOFTWARE LIFE CYCLE DYNAMIC SIMULATION MODEL: 
IHE ORGANIZATIONAL PERFORMANCE SUBMODEL 


Robert C. Tansworthe 
Jet Propulsion Laboratory 
California Institute of Technology 
Pasadena. CA 91109 


1. INTRODUCTION 

In earlier papers [1, 2]. the author, in collaboration with 
Chi Lin and Merle McKenzie, exposed structural design concepts 
for the construction of a dynamic simulation model of the 
sofi'f^re life cycle process. These works derived requirements on 
the form and granularity of the activity breakdown necessary for 
an accurate simulation. In subsequent works. Don Reifer [3. 4] 
produced a generic software life cycle work breakdown structure 
having the required level of detail, and studied the 
infrastructural dependencies among rates of production, 
utilization of staff and funding resources, product size 
characteristics, and situational and environmental factors. 

This paper is an extension of these works, describing 
further structural details of the model, the organization of the 
overall model into submodels, and the description of one of these 
submodels in detail. 


2. MODEL STRUCTURE 

2.1. Core Unit Structure 

The works cited above describe the software life cycle 
process as a dynamic cyclic architecture of project phases, each 
broken into its constituent unit-task-level activities and flows 
of products, personnel, funding, and other resources among the 
activities. Each activity is viewed as having a common 
structure, referred to as the 'core unit.' shown in Figure 1. 
The cylindrical 'tank' symbols in the figure refer to quantities, 
or 'levels.' that may flow within the model. Directed arrows 
denote paths of flow, and the oblong symbols in the flow paths 
denote rate controllers. The triangular symbol is a level 
duplicator, and the pentagonal symbol is a flow duplicator. 

2.2. The Software Life Cycle Phase Structure 

The software life cycle process treated here has one .core 
unit activity for each of the following seven major phases in the 
process : 

1. ^system requirements definition and analysis 

2. *system design and hardware /software allocation 

3. software requirements analysis 
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4. software preliminary design 

5. software detailed design, implementation, and test 

6. *system integration and testing 

7. *system maintenance 

The four phases marked with asterisks (*) above are not 
ezclnsively software-oriented. Modeling of the activities in 
these phases is limited to the involvement of software personnel. 


OF POOR QUALfTY 
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Each phase starts with a certain unknown volume of product 
that must be produced as precedent to the succeeding phases. A 
certain amount of the product will be produced correctly, some 
will be produced with a s-yet- undetected faults in it, and some of 
the product will contain faults that have been discovered, but 
not yet repaired. Even portions produced correctly may have to 
be reworked when requirements change. The rates at which each of 
these portions of the product are generated (and, for errors, 
disposed of) are dynamic functions of both inherent and 
manageable parameters. 

The production rate, or rate at which the quantity of 
product backlog is transformed into the finished product, is 
dependent, among other things, on the size and characteristics of 
the applied staff. For each phase, staff may be acquired from 
in-house resources or from the labor market. Each, upon entering 
into the new phase, may undergo a period of training (and a 
longer period of learning), perhaps administered by staff 
elements already on the job (inservice training), who take time 
out from their regular duties for this purpose. Staff may also 
be lost through attrition, or may be reassigned to activities in 
other phases or to other in-house tasks. 

Staffing requires fiscal resources in order to exist. The 
allocation and acquisition of sufficient budget to sustain the 
staff is a prime requisite for doing work in a particular phase. 
On occasion, there may some funding for a phase left over after 
the phase product is complete that may be made available to 
®®®fher phase. In some cases, funds budgeted to a particular 
activity may have to be preempted to support another phase, or 
another project. In the latter case, the funding is lost. 


2.3. Submodel Structure 

The overall simulator is divided into four parts (Figure 2): 
an organizational performance submodel, a management submodel, a 
management influence interface, and a model analyst interface. 
The organizational performance submodel includes all of the core 
unit activities, and is described by a set of differential 
equations governing the levels and flows of products, personnel, 
and funding. Orga< izational performance is completely specified 
by the current state of the levels and the flowrate functions. 

The management submodel contains a plan model, a visibility 
model, and an action model, each appropriately parametrized. 
Visibility into organizational performance is achieved via access 
to levels, flowrates, and flowrate parameters. Control is 
accomplished through manipulation of parameters within the 
management submodel interface. 

The model analyst provides non— management performance 
parameter values that are inherent to the software process and to 
the performing organization, as derived from statistical or 
conceptual data. 
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Model 

Analyst 

Interface 


Fig. 2 : Software Life Cycle Siwnlator SwbAodel Stnctwre 


3. MODEL DESCRIPTION 
3.I. Notation 

In describing the equations governing the organizational 
performance model# the following notation is used: 


Capital letters denote levels# lower-case letters denote 
flowrates and flowrate auxiliaries# and Greek characters denote 
flowrate parameters* Boldface capitals refer to cumulative 
levels across the entire submodel* Levels# rates# and parameters 
are subscripted by their phase indexes# 1 through 7# as above* 
The subscript t refers to the phase under current consideration* 
When describing the relationships of quantities within a 
particular phase# this subscript is often suppressed* 
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Some parameters may have multiple subscripts, the first of 
which is always the phase number, perhaps suppressed. However, 
if one quantity in an equation describing the behavior of the 
model bears a phase subscript, then all parameters in the 
equation are subscripted by the appropriate phase. The phase 
number is never suppressed when all quantities in an equation do 
not refer to the same phase. 

All quantities are, or potentially are, functions of time. 
The time dependency, however, is generally also suppressed for 
simplification of the formulas. 

For each phase core unit, the levels are: 

Q = Quantity of product yet to be produced 
P = amount of Product produced so far 

F = amount of Faulty product so far detected, this phase 

E = product Error (fault) content, this phase 

J = size of Job training staff pool 

S = size of trained Staff 

G ~ Group size, staff in this phase 

S = total project Staff level 

A = size of Available staff pool 

W = Work effort, this phase 

W = total Work effort, all phases 

B = unspent Budget 

C = Cost, so far this phase 

C = total Cost, so far, all phases 

t = carryover Refund pool 

The flowrates among these levels are: 

p = productivity 

r = rework rate 

d = fault detection rate 

e = error generation rate 

f = fault release rate 

h - hire rate, labor market 

w = worker reassignment rate 

m = mobility of available staff 

g = grooming (training) rate 

i = inservice training assignment rate 

q = quit (attrition) rate 

a = available staff assignment availability rate 

b == budget acquisition rate 

X = budget expenditure rate 

c = carryover rate 

y = yank (budget reduction) rate 

u ~ utilization rate of carryover pool 
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The function U(z) is the so-called 'unit-step* function 


D(x) =1 ifx=0orx>0 
= 0 otherwise 


3.2. Nozaalization 

All levels and rates defined above are normalized quantities 
with respect to amount of product, effort, budget, and time 
duration. In the following discussion, a prime symbol (*) will 
be affixed to unnormalized quantities, and unprimed symbols 
denote normalized quantities. 

Time is normalized such that unit time corresponds to a 
certain fraction of each simulated project, no matter how long 
the actual schedule is. It also will be convenient to normalize 
level values so that unit product, total effort, and total 
funding levels are used, regardless of project size. 

The same time normalization is used for all core units, 
viz., the planned schedule time to enter phase 7. The product 
levels and product flow rates within each core unit are 
normalized individually by the actual (unknown) volume of product 
for that unit. The remaining levels and rates are normalized by 
overall planned values. Effort levels and rates are normalized 
by the planned expected project effort, while funding levels and 
rates are normalized using the planned project cost. 

3.2.1. Parametric Time Normalization 

Let t* denote actual (real) time values, and t denote 
parametric time, related by 

t* = T t 

where T is the specified time-normalization parameter. Note that 
when parametric time t = 1. then real time t* = T. 

Let Z'(t*) be a flow volume, or level, and Z(t). its 
corresponding normalized equivalent under the rel *:ionship 

Z*(t*) = Zq Z(t) 

with an appropriately defined time— independent parameter Zq. 
When normalized such that = 1. the value of Zq becomes 

Zo ' Z'max 

For a flowrate z'(t'). the corresponding equation is 
z*(t*) = Zq z(t) 

The volume of flow due to z' over a period of time will be 
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finite, becaose the model deals with finite resources. Let this 
accumulated value be Z*, and the corresponding normalized value 
be Z. Because of this time normalization factor, the values Z 
and Z* are related by 

Z' = T zq Z 
or 

Zq = Z'/(Z T) = Zq/T 

where Zq is the level normalization factor. Time normalization, 
therefore, leads to T factors in the normalizing coefficients of 
flowrates. 


3.2.2. Product Normalization 

Let Pq denote the actual (unknown) final amount of product 
to be produced in a particular phase. Then the relationship 
between P' and P is 

P'(t') - Pq P(t) 

in which P is confined to the interval [0, 1]. The flowrates 
influencing the product are 

p'(t') = (Pq/T) p(t) 

and 

r'(t') = (Pq/T) r(t) 

The model thus concerns itself with unit products in each 
phase, so that the actual sizes of each unit within the 
normalized organizational submodel are immaterial. Should the 
unknown final amount of product Pq expand to Pj due to, for 
example, an increase in requirements, then the submodel would 
view this as if Pj were the normalizing factor, whereupon the 
normalized P would show a decrease by an amount (Pj^ — Pq)/P 2 * 


3.2.3. Fault Normalization 

Both detected and undetected product fault levels are 
normalized with respect to the unknown final product size. 


d(t) 
f(t) 

Therefore, E and F are measures of the relative error content in 
the product. 


E'(t') 

F'(t') 

d'(t') 

f'(t*) 


Pq E(t) 
Pq F(t) 
(Pq/T) 
(Pq/T) 
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3.2.4. Staff Nonalization 

Let Vq be tbe real planned total effort for the project, and 
let Wq be the planned effort for a core nnit. Then 

^0 “ * 1,0 * •“ * 7,0 
W'(t») - Wq W(t) 

Let Sq be a staffing normalization value defined by 
So = Wq / T 

i. e., Sq is the average full-time-equivalent staff engaged in 
the project. The flowrate normalizations are 

h'(t') = (Sq/T) h(t) 
m'(t’) = (Sq/T) m(t) 
q'(t') » (Sq/T) q(t) 
g'(t’) » (Sq/T) g(t) 
i'(t') * (Sq/T) i(t) 
a'(t') = (Sq/T) a(t) 

and the levels are 

J'(t’) » So J(t) 

S'(t') = So S(t) 

W'(t') = Wo W(t) 


3.2.5. Budget Normalization 

If Co represents the real planned total cost of a project, 
and if Co is the cost allocation made to a particular phase, then 

®0 = ^1,0 + ♦•• + C7 0 
C'(T') = Co C(t) 

The normalized cost rates are then 

b'(t') = (Co/T) b(t) 
x'(t') = (Co/T) x(t) 
y'(t') = (Co/T) y(t) 
c'(t') = (Co/T) c(t) 
u’(t’) = (Co/T) u(t) 

and the levels are 

B'(t') = Co B(t) 

C'(t') » Co C(t) 

B'(t') = Co E(t) 
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3.3. Approziaation of Time Delays 


The modeling of time delays in a process simulation model 
can be accomplished in one of two ways: all samples of the 

process may be stored in a queue during the delay time, or the 
samples may be put through a linear filter whose transfer 
characteristic approximates the desired delay. The former method 
requires a queue length equal to the process sampling rate times 
the delay time, and is appropriate whenever queue storage 
requirements are not extreme. The latter method suffers from 
amplitude and phase distortions when the degree of the delay 
is too small, but memory requirements are generally much 
more modest. Each of the methods may appear in the 
organizational performance submodel, as appropriate. 

The linear filter transfer function of degree n 
corresponding to a 'maximally flat' unit-delay is given (in 
Laplace transform notation) by the equation [5] 

Dn(s) = bQ / (bQ + bjs + ... + bj^s*^) 

where bj,, k = 0, ... , n represent the coefficients 

(2n - k)f 



2*^"^ kl (n - k)l 

The f il ters for n = 2 and n = 3 are, for example, 

3 

D2(s) = 

3 + 3s + s» 


D3<s) = 

15 + 15s + 6s* + s* 

The response of these filters may be expressed as nth- order 
linear differential equations. That is, 

y(t) = Djj(s) x(t) 

translates into the differential equation 

+ ... + bjy + boy * bQX 

For ease in computer solution, this equation is usually rewritten 
in state-vector form, in which y^ denotes the kth derivative of 
y(t), as ‘ 
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yn-1 = ^^0* " <^oyo 

^ 11-2 “ 


• « • 


+ Viyn-l>J / 


70 = yi 

In tills way, the vector of derivatives, (yQ, ... , 
determined from the state vector (yQ, ••• # time t, and 

then numerically integrated to give the state vector values at 
time t + At. 

For delay t, rather than unit delay, it is merely necessary 
to replace each above by b^ = example, the 3xd- 

order maximally-flat r-delay filter equations are 


yo - 7i 
yi = 72 

j2 = (i5/x') (x - yQ - xy|^ ” 0.4x-y2> 

4. LEVEL EQUATIONS 
4,1« Level Equation Form 

The normalized equations of flow for each core unit may now 
be completely specified in terms of flowrates and levels. As 
above, the overdot in the equations below denotes time- 
differentiation, 

t = dZ/dt 


Since all levels in the model are non-negative quantities, 
the flow equation for each level necessarily takes the form 

i = z u(z) 

so that a negative flow rate never produces a negative level. In 
the submodel level equations to follow, the step-function factor 
is omitted for simplicity. 

The level equations that follow are mere mathematical 
restatements of the flow structure depicted in Figure 1. 
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4.2. Qaantity of Product 


Each phase deals with a unit product, which, at any 
particular time, may be composed of an as-yet-unproduced Quantity 
(0). an amount having as-yet-nndiscovered Errors (E), an amount 
having discovered, unrepaired Faults (F), and an amount of 
finished, correct Product (P), 

6=r+f-p— e 

P-P- T 

fe = e — d 

F = l- Q- P- E 


4.3. Job Training Staff Pool 

The job~training level is composed of incoming untrained 
(new) staff, J^^, and trained staff, J^, brought in for inservice 
training. The overall level is described by 

J’®h + m+i — g — q j 

and the individual untrained and trained levels are 
= h + m - (Jj^/J)(g + aj + qj) 

“ i “ (J^/J)(g + aj + <ij) 

where aj is the staff assignment availability (not shown in 
Figure 1) applicable to the job training pool. 


4.4. Trained Staff 

The trained Staff, S, consists of personnel dedicated to 
production and QA activities within the current phase. 

§=g-i-as~qg 

Note that the staff assignment availability, a, in Figure 1 is, 
in reality, made up of two parts, aj and ao, respectively 
applicable to the job training pool and the trained staff pool. 
The total group staff, G, is thus described by 

6=h + m~ a — q 

where a = aj + a^ and q ~ qj- + qg. 
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4.5. Work Effort 

The Work effort level. W, is the comnlstive groap staff time 
spent so far in the current phase. 

♦ = J + S = G 


4.6. Project Work Effort 

The project cumulative work effort, W, is the current value 
of total work effort in all phases. 

W = + . . . + W7 


4.7. Available Staff 

Available staff. A, denotes a pool of personnel resources 
not currently engaged in the project, but available to do so. 
Staff completing a given phase are reassigned to the available 
staff level before being reassigned, as appropriate, to other 
phases. Staff external to the project may also be added to the 
pool by work reassignment. 

A = w + (sj ~ mj^ — ^ ... + (a^ ~ m<^ ~ ^7.A^ 


4.8. Budget 

The phase budget. B. is the current value of remaining 
dollar resources allocated to the current phase. 

B = b + u- i- c- y 


4.9. Cost 

The phase cost, C, is the current value of the phase 
expenditure. 


fc - X 


4.10. Total Cost 

The project total current cost. C. is the sum of all phase 
costs. 


C — Cj + ... + C’j 
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4.11. Carryover Kefund Pool 

The carryover refund pool, E, is the total of all funds 
given up by some phases and not yet utilized (obligated) to other 
phases. 

~ Oj) + ... + (C’J — U-j) 

5. lATE EQUATIONS 

The formulation of the organizational performance model, as 
can be seen from the foregoing paragraphs, places the burden of 
achieving simulation accuracy in proper definition of rate 
equations and initial values for levels. This section 
parametrizes the flowrate quantities using simple, intuitive 
phenomenological models, as follows: 

5.1. Productivity 

The general form for the productivity, or production rate, 
equation is 


P - PO Pj Pc Pq Ps Pi • • • Pn 

where Pq is a nominal time-independent productivity value for 
trained staff, pj is an adjustment factor for staff in training. 
Pc * compensation for communication overhead and other effects 
of overall project staff size, p^ adjusts for effort being used 
in error-detection and quality assurance (QA), p^ compensates for 
learning effects in the phase, and the other multipliers p^ are 
adjustments due to environmental, situational, organizational, 
experience, and other factors. 

Each of the phase products is considered a separate, 
precedent milestone for doing correct work in the succeeding 
phases. Work may still be done without having 100% precedent in 
succeeding phases, but there will be a higher probability of 
making errors in that work that will later have to be corrected. 
No total overall product metric is defined. 

5.1.1. Job Training Pool Effects 

The effects of having a staff group G split between an 
untrained staff pool (J) and trained staff pool (S) is modeled by 
the productivity adjustment factor 


Pj = S + jtjJ 


where xfj is a productivity ratio value for staff in the job- 
training pool (J), including personnel doing the training* It 
principally reflects the effects of time spent in training 
activities rather than in production* Learning-curve effects are 
treated separately^ below. The parameter Jij is supplied by the 
management submodel. 
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S.1.2. Coamnnications Overhead 

One productivity adjustment is due to organizational 
communications overhead. This overhead is simulated using an 
overhead model [6] that postulates that the time increment spent 
in overhead activities is proportional to the staff increment and 
the non-overhead time remaining. The productivity adjustment 
factor in this case is given by 

p^j = expI-(S - l/So)Ygl 
for S > 1 /Sq, and p^ = 1 otherwise. 

The parameter y is the communications relative time factor, 
supplied by the model analyst. 


5.1.3. Staffing and Learning Curve Effects 

It is generally accepted that productivity of personnel 
increases due to several kinds of learning, among which are 
general experience, organizational experience, and specific task 
familiarity. Each of these productivity effects is commonly 
described dynamically by a first-order linear differential 
equation having a 'learning time-constant' parameter. 

The organizational response submodel approximates only the 
task familiarization effects, and relegates the other, longer- 
term experience adjustments to other pj^ factors. Thus, the total 
staff productivity due to size and state of familiarity is taken 
to be the form. 


Ps = ”0 + "s / ® 
where n. satisfies the equation 

s 

^s”s + "s “ ® 

in which is the learning time-constant, G is the staffing 
function to which that kind of learning applies, and Kq 
represents the untrained-staff /trained-staff productivity ratio. 
The trained-staff productivity is thus normalized to unity. 

The value of p^ is the learning-state productivity 
adjustment for the staff group G as a function of time. If the 
staff G were applied all at once, p^ would rise from Wq 
asymptotically to 1. However, since the staffing plan may not be 
a step-function, the differential equation form is used. 

The learning time parameter is a function of the 
teacher/student ratio, p, and is longest when staff members learn 
on their own (i. e., at x q, when p = 0 ). 
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The variation in learning time may be approximated by a 
cubic form 


S + ■'s P “ P>* ■ 3) 

This particular form takes on the self-taught time value at 
p = 0, is minimum when the teacher/student ratio is unity, being 
reduced by a (positive) increment At^ at this point, and has 
(negative) slope at the origin. For p > 1, it was assumed 
that there would be too many teachers per student, so that the 
training time would actually take longer than 1-on-l training. 
The form is subject to the restriction 

AXg > - T' / 2 > 0 

The parameters «q, q, and all are supplied by the 
model analyst interface. * 


5.1.4. Effect of Quality Assurance 

If represents the fraction of effort devoted to quality 
assurance (QA) pursuits (i. e., the 'extent' of QA) to discover 
errors or otherwise improve the quality of product, there is a 
corresponding reduction in productivity due to the reduced 
effort. Nevertheless, the overall correct-product rate maybe 
improved, because faults may be discovered before they propigate 
into other phases. 

The productivity adjustment factor for QA activity is thus 
of the linear type. 


P 


q 


= 1 - 


^q 


The QA fraction emanates from the management submodel. 


5.1.5. Linear Extent Factors 

Other productivity adjustment factors may take the linear 
form exhibited above, 

p^ « 1 + for > -1 

“ 0 otherwise 

The extent factors range in the intervals [0, 11 or [-1, 11. 
In either case, the productivity adjustment factor ranges from 
its least to most beneficial value as varies from the lower to 
the upper limit. In the former case, Jt^ is the total swing in 
productivity adjustment, 

”k ~ ^k(max) “ Pk(min) 

while in the latter case, it is only half this amount. 
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The parameters are supplied by the model analyst for 
projects in general, while the are supplied by the model user 
to relate the extent to which each factor under consideration is 
present in the project to he simulated. 


5.1.6. Exponential Extent Factors 

Several productivity adjustment factors take the form 
Pk “ 

where > 1 is the maximum beneficial effect of project factor 
k, and 5 = is a value in the interval [-1, +1] that registers 
the extent to which factor k is present in the current project. 
When 5k ~ tkere is minimum benefit of factor k, so the value 
is seen to be the square of the max/min productivity ratio. 

~ Pk(max) ^ Pk(min) 

The parameters are supplied by the model analyst for projects 
in general, while the 5k supplied by the model user to relate 
the extent to which the factor under consideration is present in 
the project to be simulated. 


5.2. Error Generation Rate 

The rate that undetected errors are introduced into the 
product of a given phase is assumed to be proportional to the 
rate at which the product is being produced. That is, all other 
things being equal, the error content per unit of product would 
be the same. Also, the error content is assumed to decrease as 
the staff comes up on the learning curve, by an amount 
proportionate to the staff's increase in productivity. 
Additionally, the error rate depends on the amount of products in 
precedent phases not yet produced, or produced in error. For 
example, if the software requirements generated as the product of 
phase 3 are incomplete or in error, yet phase 5 insists on doing 
implementation, then there will be a higher likelihood of work 
being erroneously done ir«. phase 5. Parametrically, the error 
generation rate takes the iurm 

e = (p / Pj) teo + (Qj + Fi)ei + ... + (Q0_i + 

+ ^ ^ 7 ^ 7 ^ 

The quantity Cq represents the relative volume of errors that 
would be introduced in the current phase, even if all precedent 
work were completed. Each and reflects an increase in 
error generation rate in the current phase due to incompleted 
products (Q^ + Fj^) and errors (Ej^) of precedent phases* The 
contribution to error generation due to incompleted products is 
termed 'speculative error'. The error generation due to 
precedent errors is 'compounded error'. 


1-331 


This model of error creation presomes that the magnitudes of 
the product levels and detected fault levels of precedent phases 
are immediately transmitted to the current phase. While this may 
not be generally true, preliminary results are often made 
available at regular intervals. If the project behavior is 
sensitive to this assumption, each of the and in the 

error rate equation above may be delayed by a parametric amount, 
e. g.. 


The values and are supplied to the organizational 
performance submodel by the model analyst, and T|. comes from the 
management submodel. 


5.3. Fault Detection Rate 

The rate at which faults are detected is assumed to be a 
function of the productivity of the effort devoted to finding 
errors (QA), the number of errors yet undetected, and the 
detectability of those errors. The following linear form is 
postulated: 


= E0 {P0 &0.0 150, q / <1-50, q)l + 

... + P 7 60^7 [57 q / (1-57 q)]) 

The 5^ are related to the ease with which a (later) phase k 
detects an error created in the current phase, and are supplied 
to the organizational performance submodel by the model analyst. 


5.4. Fault Release Rate 

The rate at which work detected to be faulty is released 
back to the product backlog queue depends heavily on management 
policy and decision. In some instances, work is immediately 
released to be corrected. In other cases, work may be held for 
correction in a later software version update. Therefore, the 
release function, f, is supplied to the organizational 
performance submodel via the management submodel. 


5.5. Rework Rate 

Rework here is the process of returning portions of a phase 
product back to the product backlog queue. Such action is 'taken 
when improvements to a phase's products are in order, or when 
requirements change and a revision is necessary* Both of these 
situations are management driven, and thus the rework rate 
function, r, is supplied via the management submodel interface. 
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5*6. Outside Hire Kste 


The hire rate from the external labor pool* h* will also be 
designated as a function supplied by the management submodel, 
since the strategy governing hires is a management prerogative. 


5.7. Work Keassignment Kate 

The rate at which personnel from outside the project are 
made available for use in the project is controlled by 
management. Hence, the work reassignment rate, w, emanates from 
the management submodel. 


5.8. Staff Mobility Rate 

As with outside hire rate, the mobility strategy, m, or use 
of available staff, is provided within the management interface. 


5.9. Staff Attrition Rate 


Staff attrition rates within the job-training pool. 


trained staff pool, and available staff pool are as 
be the same proportion of the staff levels involved; 


> wim A af 


the 

all 


“ 9o ^ 

9s ~ 9o S 

9a = 9o ^ 

The attrition coefficients, qQ, are supplied by the management 
submodel . 


5.10. Staff Inservice Training 

The assignment of trained staff to perform inservice 
training is a management action, whose purpose is to shorten the 
training period for incoming untrained staff. "XTie assignment is 
assumed to depend on the number to be trained, and the number 
available to train them. An inservice assignment rate of 

i = (pJ„ - / Ti 

will bring (asymptotically) a trained-to-untrained personnel 
ratio (i.e., a teacher/ student ratio) of p = into the 

training pool. The time-constant reflects the time required 
to break trained staff free and bring them into the training 
activity. Both the teacher/ student ratio, p, and the time 
constant are defined within the management submodel. 
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5*11. Staff Grooaing Rate 


Persomiel t«cei»in* job-tt«inl«, from others ere estomed to 
speod . fired, finite time et their stodi.,, or in oleserooms. 
Thereafter, they commence activities as trained staff. If x 

represents the nominal time spent in snch activities* then thf 
'grooming' rate is 


g(t) - h(t - Tg) + m(t - Tg) + i(t - Tg) - q^J(t - Tg) 

That is, the transfer of personnel from training activities into 
productive status is modeled as a mere time delay imposed on the 
inflow into the training pool. The training time parameter x is 
defined by the management submodel* ^ 


5,12. Staff Assignment Availability 

Staff assignment is a management prerogative* so the 
assignment availability functions* aJ and ao* are provided by the 
management submodel. ^ 


5.13. Budget Acquisition Rate 

Funding acqui sition* distribution among phases* and time of 
activity initiation are management functions* so the budget 
acquisition rate* b* controlling these characteristics* is 
provided by the management submodel. 


5.14. Budget Expenditure Rate 

Budget expenditures in a given phase are primarily due to 
two factors: personnel and product costs. 

X = UqG + Up(p + e) 

The parameter is the average burdened wage of the group staff* 
and is the non-personnel-related production cost per unit 
product. The latter term includes costs to create errors in the 
product* as well as to generate correct product. In all **hases* 
« includes documentation. During the implementation and testing 
phases* it also includes computer utilization and other support 
costs. The management submodel supplies both and m . 

u p 

5.15, Budget Reduction Rate 

may* at times* increase or decrease a task's 
unding allotment. A decrease that is lost to the project is 
termed the 'budget reduction*' or 'yank' rate. The amounts of 
reductions and conditions for initiating such events are not part 
of the organizational response* although the effects within the 
project caused by such reductions are. The yank function* y* is 
therefore* supplied by the management submodel. 
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5.16. Budget Carryover Kate 


Budget carryover, or the release of funding from one phase 
for use elsewhere within the project, is a management 
prerogative. The carryover function, c. therefore emanates from 
the management submodel. 


5.17. Budget Carryover Utilization Rate 

Rentilization of carryover (and contingency) funds is a 
management control, and. therefore, the reutilization strategy, 
u. is supplied by the management submodel. 


APPENDICES 


APPBIDIX A 

HAIIAGEMBNT SUBMODEL IMTEIFACB 

Parameters needed by the organizational response submodel 
supplied by the management submodel are contained in this 
appendix. The parameter subscript k refers to phase k, where k 
ranges from 1 through 7. 

5k, q Fraction of effort applied to QA 

Training productivity ratio 

5k, j Extent of productivity factor j * 1, ... » n^ ^ 

^k,j delay with which product-information from 

phase j is known in phase k, for j < k 

f]^ Fault release rate strategy 

Product rework strategy 

h^ Outside-hire rate 

*k Staff work reassignment rate from outside the 

project 

®k Staff mobility rate 

^k,0 Staff attrition rate 

Pk Training ratio 

^k, i Inservice instructor break-free time constant 

’^k.g Inservice training grooming time delay 

*k,J» *S Staff reassignment availability 

^k Budget acquisition rate 

®k,G Average staff burdened wage 

“k,p Production costs per-unit of product 

Xk Bebudget yank rate 

®k Budget carryover 

«k Budget carryover reutilization 
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Parameters witbin tbe management anbmodel vbich interface 
with the nser are: 

0 Actual amount of product for pbase k 

Planned overall work efforts Staff-montbs 

0 

T Planned project time duration, months 

Planned project cost, constant dollars 
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appendix b 

MODEL ANALYST INTERFACE 


Parameters supplied by the model analyst interface are 
contained in this appendix. The parameter subscript k refers to 
phase k, where k ranges from 1 through 7. 


Pk,0 

^k,c 


”k,0 

■'k.s.O 

^k.'s 


At- 


kp s 


n 


k.j 


“V T, 

a*p 

®k,0 




Nominal organizational productivity 

Communications overhead time factor 

Untrained staff relative productivity 

Staff self-taught learning time— constant 

Staff inservice learning time-constant slope 

Maximum inservice learning time-constant 
reduction factor 

Productivity adjustment coefficient, factor j, 

j =1, ... , nj.^p 

Number of productivity factors 

Phase k inherent error generation rate 

Speculative error generation rate in phase k due 
to uncompleted precedent work and uncorrected 
detected faults in phase j, j < k 

Compounded error generation rate in phase k due to 
undetected faults in phase j. j < k 

Detectability of faults created in phase k during 
phase j , j >= k 
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JPL QUANTITY LEVEL, PER PHASE 
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JPL QUANTITY CHANGE RATES, PER PHASE 
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REBUDGET (LOSS) RATE 
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JPL MODEL ANALYST INTERFACE, PER PHASE 
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JPL MANAGEMENT SUBMODEL INTERFACE, PER PHASE 
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JPL MANAGEMENT SUBMODEL INTERFACE (CONT’D) 
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• FOLDED KNOWLEDGE INTO A FUNCTIONING TWO- PHASE MODEL (S/W REQUIREMENTS, 
ARCHITECTURAL DESIGN) BASED ON SELECTED SCENARIOS 

• TESTED MODEL STRUCTURE, PARAMETER VALUES, AND BEHAVIOR 


JPL MANAGEMENT SUBMODEL COMPONENTS 



CO 



< 


< 

Q_ 

O 

< 




CO 

LU 


O 

Q- 


o 



w 

1— 

Q 





CO 

LU 


O 



LU 



< 




< 
1 




uu 

Q 

LU 

Q_ 

1 — 
LU 

O 


o 

LU 


u. 

o 

o 




< 

LU 



o 


1 

m 

uu 

LU 



CO 

o 

CO 



0 

1 t 1 

CO 

\ 

o 

f— 

< 

:r. 

on 



f— 

O 

D- 

O 


< 

Q- 

Q 

LU 

Otl 

LU 

Qs: 

< 

O- 

CO 

:z) 

o 

LU 

co’" 

LU 


o 

<c 

O- 


> 

1— 

c 


h- 

Q 

LxJ 

OC 

o 

o 

o 

o 

1— 

LU 

OC 

Q_ 

LU 

Q 

LU 

Q 

< 

< 

Q 

LU 


< 

1 1 1 

Q- 

LU 

H“ 

LU 

O- 

co 

1— 

CO 

ct: 

< 

o 

CJ> 

LU 

LU 

< 

Q_ 

LU 


LU 

> 

CO 

o 

o 

O 

O 

OQ 

O 

LU 

LU 
1 

LU 

1 

1 

o 

CO 

|— 

CO 

Q_ 

< 


CO 

o 

LU 

o 

1— 

LU 

O 

1— 

o 

o 

LU 

O 

CO 

o 

LU 

Q 

~T~ 

1— 

CO 

CO 

LU 

I 

o 


LU 
1 

o 

X 

LU 



O 

< 

in 


< 


> 


# 

• 


• 

• 




1-355 


CYL/MM-2 


MANAGEMENT SUBMODEL 
COMPONENTS (Con’t) 
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MANAGEMENT POLICY ON WORKER ENVIRONMENT, AND INPUTS THERETO 


EXAMPLES OF MANAGEMENT 

JPL CONTROL PROCESS 
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EXAMPLES OF MANAGEMENT 
CONTROL PROCESS 
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